Apr 28 15:08:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:08:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:08:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:08:07 devstack cinder-volume[75576]: INFO dbcounter [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Registered counter for database cinder Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writer thread running {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:08:07 devstack cinder-volume[75576]: INFO cinder.rpc [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 15:08:07 devstack cinder-volume[75576]: INFO cinder.rpc [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:08:07 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Determined volume DB was empty at startup. Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75576) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 15:08:07 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 15:08:07 devstack cinder-volume[75576]: WARNING stevedore.named [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 15:08:07 devstack cinder-volume[75576]: WARNING castellan.key_manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:08:07 devstack cinder-volume[75576]: WARNING cinder.keymgr.conf_key_mgr [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75576) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 28 15:08:07 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.332s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:08:08 devstack cinder-volume[75576]: INFO cinder.rpc [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 28 15:08:08 devstack cinder-volume[75576]: INFO cinder.rpc [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 28 15:08:08 devstack cinder-volume[75576]: WARNING stevedore.named [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 15:08:08 devstack cinder-volume[75576]: WARNING castellan.key_manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:08:08 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:08:08 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Starting 1 workers Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Started child 75739 {{(pid=75576) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Full set of CONF: {{(pid=75576) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] ******************************************************************************** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Configuration options gathered from: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] ================================================================================ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] allow_availability_zone_fallback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] allow_compression_on_image_upload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] allowed_direct_url_schemes = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] api_rate_limit = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] auth_strategy = keystone {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] az_cache_duration = 3600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75739]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_host = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_stats_polling_interval = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backup_api_class = cinder.backup.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backup_name_template = backup-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backup_use_same_host = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backup_use_temp_snapshot = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] chap_username = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_internal_tenant_project_id = 2d39744aee1840acaa2e332e5f12305e {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_internal_tenant_user_id = 6c313bf3c094422b92c060715aa39b42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cloned_volume_same_az = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cluster = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] compression_format = gzip {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] config_dir = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] config_source = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] control_exchange = openstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] debug = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] default_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] default_group_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] default_volume_type = lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_ssl_cert_verify = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] driver_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] enable_force_upload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] enable_new_services = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] enable_unsupported_driver = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] enforce_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_api_insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_api_ssl_compression = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_ca_certificates_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_num_retries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance_request_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] graceful_shutdown_timeout = 5 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] group_api_class = cinder.group.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] host = devstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_compress_on_upload = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_conversion_address_space_limit = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_conversion_cpu_limit = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_conversion_disable = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_upload_use_cinder_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_upload_use_internal_tenant = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_volume_cache_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_volume_cache_max_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] init_host_max_objects_retrieval = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] instance_format = [instance: %(uuid)s] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iscsi_target_flags = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iscsi_write_cache = on {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iser_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iser_ip_address = 192.168.122.42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iser_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_color = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_config_append = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_options = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_rotate_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_rotate_interval_type = days {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] log_rotation_type = none {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] max_age = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] max_logfile_count = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] max_logfile_size_mb = 200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] max_over_subscription_ratio = 20.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] message_reap_interval = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] message_ttl = 2592000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] monkey_patch = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] monkey_patch_modules = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] my_ip = 192.168.122.42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] no_snapshot_gb_quota = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] num_iser_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] num_shell_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] num_volume_device_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack sudo[75747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] nvmeof_conn_info_version = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] nvmet_ns_id = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack sudo[75747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:08 devstack cinder-volume[75739]: INFO cinder.volume.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] nvmet_port_id = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_max_limit = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_ext_list = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_listen_port = 8776 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] osapi_volume_workers = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] per_volume_size_limit = -1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] periodic_fuzzy_delay = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] periodic_interval = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] public_endpoint = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] publish_errors = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_backup_gigabytes = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_backups = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_gigabytes = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_groups = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_snapshots = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] quota_volumes = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] rate_limit_burst = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] rate_limit_except_level = CRITICAL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] rate_limit_interval = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] reinit_driver_count = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] report_discard_supported = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] report_interval = 120 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] reservation_clean_interval = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] reservation_expire = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] reserved_image_namespaces = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] reserved_percentage = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] rpc_response_timeout = 120 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] run_external_periodic_tasks = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] scst_target_driver = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_down_time = 720 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] shell_completion = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] snapshot_name_template = snapshot-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] snapshot_same_host = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] state_path = /opt/stack/data/cinder {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] storage_availability_zone = nova {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] storage_protocol = iSCSI {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] syslog_log_facility = LOG_USER {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_helper = lioadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_ip_address = 192.168.122.42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] target_secondary_ip_addresses = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] transport_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] until_refresh = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_chap_auth = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_default_quota_class = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_journal = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_json = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_stderr = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] use_syslog = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] verify_glance_signatures = enabled {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_api_class = cinder.volume.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_clear_size = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_copy_bps_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_dd_blocksize = 1M {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_name_template = volume-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_service_inithost_offload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volume_usage_audit_period = month {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] zoning_mode = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.admin_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.admin_token = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.admin_user = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_port = 35357 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_protocol = https {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_uri = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.auth_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.cache = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.identity_uri = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.interface = public {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_password = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcache_username = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.service_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.backend = dogpile.cache.null {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.backend_argument = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.backend_expiration_time = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.config_prefix = cache.oslo {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.debug_cache_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.enable_retry_client = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.enable_socket_keepalive = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.enforce_fips_mode = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.expiration_time = 600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_dead_retry = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_sasl_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.proxies = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.redis_db = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.redis_server = localhost:6379 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.retry_attempts = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.retry_delay = 0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.socket_keepalive_count = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.socket_keepalive_idle = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.socket_keepalive_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.socket_timeout = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.tls_allowed_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.tls_cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.tls_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.tls_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.tls_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cache.username = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] coordination.backend_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.asyncio_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:08 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.asyncio_slave_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.backend = sqlalchemy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.connection_debug = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.connection_parameters = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.connection_recycle_time = 3600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.connection_trace = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.db_inc_retry_interval = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.db_max_retries = 20 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.db_max_retry_interval = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.db_retry_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.max_overflow = 50 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.max_pool_size = 5 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:08 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.max_retries = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.pool_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.retry_interval = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.slave_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.sqlite_synchronous = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.synchronous_reader = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] database.use_db_reconnect = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.connection_string = messaging:// {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.es_doc_type = notification {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.es_scroll_size = 10000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.es_scroll_time = 2m {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.filter_error_trace = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.hmac_keys = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.sentinel_service_name = mymaster {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.socket_timeout = 0.1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.trace_requests = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler.trace_sqlalchemy = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler_jaeger.process_tags = {} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] profiler_otlp.service_name_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.enforce_new_defaults = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: WARNING oslo_config.cfg [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.enforce_scope = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.policy_default_rule = default {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.group = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.helper_command = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] privsep_osbrick.user = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.group = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.helper_command = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] cinder_sys_admin.user = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.send_service_user_token = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] service_user.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] glance.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.chap_username = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.driver_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.extra_capabilities = {} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iscsi_target_flags = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iser_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.lvm_share_target = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.lvm_type = auto {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.report_discard_supported = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.use_chap_auth = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_reports.file_event_handler = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_reports.log_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.backend_host = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.chap_username = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iser_helper = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iser_port = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.lvm_type = auto {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.storage_protocol = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_ip_address = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] lvmdriver-1.volumes_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_notifications.driver = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] key_manager.fixed_key = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.barbican_api_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.barbican_endpoint = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.barbican_endpoint_type = public {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.barbican_region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.number_of_retries = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.retry_delay = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.send_service_user_token = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.verify_ssl = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican.verify_ssl_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.auth_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] barbican_service_user.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.approle_role_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.approle_secret_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.kv_mountpoint = secret {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.kv_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.kv_version = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.root_token_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.ssl_ca_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:08:09 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] ******************************************************************************** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 15:08:09 devstack sudo[75747]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:09 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.878s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:09 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:09 devstack sudo[75865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:09 devstack sudo[75865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:10 devstack sudo[75865]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.655s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:08:10 devstack cinder-volume[75739]: INFO cinder.brick.local_dev.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:10 devstack sudo[76082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:10 devstack sudo[76082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:10 devstack sudo[76082]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG cinder.brick.local_dev.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75739) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 28 15:08:10 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:10 devstack sudo[76307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:10 devstack sudo[76307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:11 devstack sudo[76307]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:11 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.118s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:11 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:11 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:11 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:11 devstack sudo[76470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:11 devstack sudo[76470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:12 devstack sudo[76470]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:12 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.947s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:12 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:12 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:12 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:12 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 28 15:08:12 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:13 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:13 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.659s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:13 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:13 devstack sudo[76528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:13 devstack sudo[76528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:14 devstack sudo[76528]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:14 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:14 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:14 devstack sudo[76533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:14 devstack sudo[76533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:14 devstack sudo[76533]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:14 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:14 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:14 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:14 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:15 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:15 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:15 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:15 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:15 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:16 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:16 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.856s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:16 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:16 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:16 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:16 devstack sudo[76548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:16 devstack sudo[76548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:17 devstack sudo[76548]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:17 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.869s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:17 devstack cinder-volume[75739]: INFO cinder.volume.drivers.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 28 15:08:17 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:17 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:17 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:17 devstack sudo[76561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:17 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:18 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:18 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:18 devstack cinder-volume[75739]: DEBUG cinder.volume.drivers.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Updating volume stats {{(pid=75739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 15:08:18 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:18 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:18 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:18 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:08:18 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:18 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:18 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:18 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:18 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:19 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:19 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:19 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:19 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:19 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:19 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:19 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.570s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:19 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:19 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:19 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:20 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:20 devstack cinder-volume[75739]: INFO cinder.volume.driver [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG cinder.volume.driver [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75739) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG oslo_db.sqlalchemy.engines [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75739) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG dbcounter [-] [75739] Writer thread running {{(pid=75739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG cinder.db.sqlalchemy.api [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Building query based on filter {{(pid=75739) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG cinder.image.image_utils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75739) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 15:08:20 devstack cinder-volume[75739]: INFO cinder.keymgr.migration [None req-e8705262-f694-4b5c-a25b-50cd72ffe6bb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG cinder.volume.drivers.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Updating volume stats {{(pid=75739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 15:08:20 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:20 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:20 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:21 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:21 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:21 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:21 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:21 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:21 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:21 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:21 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:21 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:21 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:22 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:22 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:22 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:22 devstack sudo[76839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:22 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:23 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG cinder.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Notifying Schedulers of capabilities ... {{(pid=75739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:08:23 devstack cinder-volume[75739]: INFO cinder.volume.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Driver initialization completed successfully. Apr 28 15:08:23 devstack cinder-volume[75739]: INFO cinder.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Initiating service 2 cleanup Apr 28 15:08:23 devstack cinder-volume[75739]: INFO cinder.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Service 2 cleanup completed. Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG cinder.service [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Creating RPC server for service cinder-volume {{(pid=75739) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG cinder.service [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75739) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 15:08:23 devstack cinder-volume[75739]: INFO cinder.volume.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG cinder.volume.drivers.lvm [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Updating volume stats {{(pid=75739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:23 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:08:23 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:23 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:23 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:23 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:23 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:24 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:24 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:24 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:24 devstack sudo[76861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:08:24 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:25 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:25 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.602s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:25 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:08:25 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:08:25 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:08:25 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Apr 28 15:08:25 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:08:25 devstack cinder-volume[75739]: INFO cinder.volume.manager [None req-0a14be97-eae8-406a-b175-c511093c4d83 None None] Driver post RPC initialization completed successfully. Apr 28 15:08:33 devstack cinder-volume[75739]: DEBUG dbcounter [-] [75739] Writing DB stats cinder:SELECT=2 {{(pid=75739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:08:35 devstack cinder-volume[75739]: DEBUG dbcounter [-] [75739] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:10:03 devstack cinder-volume[75739]: DEBUG oslo_service.periodic_task [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:10:03 devstack cinder-volume[75739]: DEBUG cinder.volume.drivers.lvm [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Updating volume stats {{(pid=75739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 15:10:03 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:10:03 devstack sudo[81667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:10:03 devstack sudo[81667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:10:04 devstack sudo[81667]: pam_unix(sudo:session): session closed for user root Apr 28 15:10:04 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:10:04 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:10:04 devstack sudo[81671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:10:04 devstack sudo[81671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:10:05 devstack sudo[81671]: pam_unix(sudo:session): session closed for user root Apr 28 15:10:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:10:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:10:05 devstack sudo[81675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:10:05 devstack sudo[81675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:10:05 devstack sudo[81675]: pam_unix(sudo:session): session closed for user root Apr 28 15:10:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:10:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:10:05 devstack sudo[81694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:10:05 devstack sudo[81694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:10:06 devstack sudo[81694]: pam_unix(sudo:session): session closed for user root Apr 28 15:10:06 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:10:06 devstack cinder-volume[75739]: DEBUG cinder.manager [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Notifying Schedulers of capabilities ... {{(pid=75739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:10:35 devstack cinder-volume[75739]: DEBUG dbcounter [-] [75739] Writing DB stats cinder:SELECT=1 {{(pid=75739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:10:35 devstack cinder-volume[75739]: DEBUG dbcounter [-] [75739] Writing DB stats cinder:UPDATE=1 {{(pid=75739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:11:03 devstack cinder-volume[75739]: DEBUG oslo_service.periodic_task [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:11:03 devstack cinder-volume[75739]: DEBUG cinder.volume.drivers.lvm [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Updating volume stats {{(pid=75739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 15:11:03 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:03 devstack sudo[82873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 15:11:03 devstack sudo[82873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:04 devstack sudo[82873]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:04 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:04 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:04 devstack sudo[82956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:11:04 devstack sudo[82956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:05 devstack sudo[82956]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:05 devstack sudo[82980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 15:11:05 devstack sudo[82980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:05 devstack sudo[82980]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.583s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:05 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:05 devstack sudo[82989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 15:11:05 devstack sudo[82989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:06 devstack sudo[82989]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:06 devstack cinder-volume[75739]: DEBUG oslo_concurrency.processutils [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=75739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:06 devstack cinder-volume[75739]: DEBUG cinder.manager [None req-d9cd2879-be70-4ce0-a306-6acacc4b96a4 None None] Notifying Schedulers of capabilities ... {{(pid=75739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:11:12 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Caught SIGTERM, stopping children Apr 28 15:11:12 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Acquiring lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:12 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Acquired lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:12 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Releasing lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:12 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Stop services. {{(pid=75576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 15:11:12 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Killing children. {{(pid=75576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 15:11:12 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Waiting on 1 children to exit Apr 28 15:11:13 devstack cinder-volume[75739]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Acquiring lock "singleton_lock" {{(pid=75739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:13 devstack cinder-volume[75739]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Acquired lock "singleton_lock" {{(pid=75739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:13 devstack cinder-volume[75739]: DEBUG oslo_concurrency.lockutils [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Releasing lock "singleton_lock" {{(pid=75739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:13 devstack cinder-volume[75739]: WARNING amqp [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 15:11:13 devstack cinder-volume[75739]: WARNING amqp [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 15:11:13 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-8062f0fc-f5ec-4048-8883-0c73a8bcd7f7 None None] Child 75739 exited with status 0 Apr 28 15:11:15 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:15 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:15 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:16 devstack cinder-volume[83367]: INFO dbcounter [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Registered counter for database cinder Apr 28 15:11:16 devstack cinder-volume[83367]: DEBUG oslo_db.sqlalchemy.engines [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:16 devstack cinder-volume[83367]: DEBUG dbcounter [-] [83367] Writer thread running {{(pid=83367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:11:16 devstack cinder-volume[83367]: INFO cinder.rpc [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 15:11:16 devstack cinder-volume[83367]: INFO cinder.rpc [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 15:11:16 devstack cinder-volume[83367]: DEBUG oslo_db.sqlalchemy.engines [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:17 devstack cinder-volume[83367]: INFO cinder.volume.manager [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Determined volume DB was empty at startup. Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG cinder.volume.manager [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83367) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 15:11:17 devstack cinder-volume[83367]: INFO cinder.volume.manager [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 15:11:17 devstack cinder-volume[83367]: WARNING stevedore.named [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 15:11:17 devstack cinder-volume[83367]: WARNING castellan.key_manager [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:11:17 devstack cinder-volume[83367]: WARNING cinder.keymgr.conf_key_mgr [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:11:17 devstack cinder-volume[83367]: INFO cinder.volume.manager [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_db.sqlalchemy.engines [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:17 devstack cinder-volume[83367]: INFO oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Starting 1 workers Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Started child 83629 {{(pid=83367) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Full set of CONF: {{(pid=83367) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] ******************************************************************************** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Configuration options gathered from: {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] ================================================================================ {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] allow_availability_zone_fallback = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] allow_compression_on_image_upload = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] allowed_direct_url_schemes = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] api_rate_limit = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] auth_strategy = keystone {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_availability_zone = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_host = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83629]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_stats_polling_interval = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backup_api_class = cinder.backup.api.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backup_name_template = backup-%s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backup_use_same_host = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backup_use_temp_snapshot = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] chap_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] chap_username = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_internal_tenant_project_id = 2d39744aee1840acaa2e332e5f12305e {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_internal_tenant_user_id = 6c313bf3c094422b92c060715aa39b42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cluster = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] compression_format = gzip {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] compute_api_class = cinder.compute.nova.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] config_dir = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] config_source = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] control_exchange = openstack {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] debug = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] default_availability_zone = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] default_group_type = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] default_volume_type = QuobyteHD {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] disk_geometry = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_client_cert = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_client_cert_key = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_data_namespace = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_ssl_cert_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_ssl_cert_verify = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] driver_use_ssl = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] enable_new_services = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] enable_unsupported_driver = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] enabled_backends = ['QuobyteHD'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] enforce_multipath_for_image_xfer = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] filter_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_api_insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_api_ssl_compression = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_ca_certificates_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_catalog_info = image:glance:publicURL {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_num_retries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance_request_timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] goodness_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] graceful_shutdown_timeout = 5 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] group_api_class = cinder.group.api.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] host = devstack {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_compress_on_upload = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_conversion_address_space_limit = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_conversion_cpu_limit = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_conversion_disable = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_upload_use_cinder_backend = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_upload_use_internal_tenant = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_volume_cache_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_volume_cache_max_count = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] image_volume_cache_max_size_gb = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] init_host_max_objects_retrieval = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] instance_format = [instance: %(uuid)s] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iscsi_target_flags = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iscsi_write_cache = on {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iser_helper = tgtadm {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.remotefs [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83629) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iser_ip_address = 192.168.122.42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iser_port = 3260 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_color = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_config_append = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_dir = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_options = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_rotate_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_rotate_interval_type = days {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] log_rotation_type = none {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] max_age = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] max_logfile_count = 30 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] max_logfile_size_mb = 200 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] max_over_subscription_ratio = 20.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] message_reap_interval = 86400 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] message_ttl = 2592000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] migration_create_volume_timeout_secs = 300 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] monkey_patch = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] monkey_patch_modules = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] my_ip = 192.168.122.42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] no_snapshot_gb_quota = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] num_iser_scan_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] num_shell_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] num_volume_device_scan_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] nvmeof_conn_info_version = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] nvmet_ns_id = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] nvmet_port_id = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_max_limit = 1000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_ext_list = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_listen_port = 8776 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_use_ssl = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] osapi_volume_workers = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] per_volume_size_limit = -1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] periodic_fuzzy_delay = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] periodic_interval = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] public_endpoint = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] publish_errors = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_backup_gigabytes = 1000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_backups = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_gigabytes = 1000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_groups = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_snapshots = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] quota_volumes = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] rate_limit_burst = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] rate_limit_except_level = CRITICAL {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] rate_limit_interval = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] reinit_driver_count = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] replication_device = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] report_discard_supported = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] report_interval = 120 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] reservation_clean_interval = 86400 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] reservation_expire = 86400 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] reserved_image_namespaces = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] reserved_percentage = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] rpc_response_timeout = 120 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] run_external_periodic_tasks = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] scst_target_driver = iscsi {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] scst_target_iqn_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_down_time = 720 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] shell_completion = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] snapshot_name_template = snapshot-%s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] split_loggers = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] state_path = /opt/stack/data/cinder {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] storage_availability_zone = nova {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] storage_protocol = iSCSI {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] syslog_log_facility = LOG_USER {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_helper = lioadm {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_ip_address = 192.168.122.42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_port = 3260 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_protocol = iscsi {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] target_secondary_ip_addresses = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] trace_flags = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] transport_url = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] until_refresh = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_chap_auth = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_default_quota_class = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_journal = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_json = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_multipath_for_image_xfer = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_stderr = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] use_syslog = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] verify_glance_signatures = enabled {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_api_class = cinder.volume.api.API {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_backend_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_clear = zero {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_clear_ionice = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_clear_size = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_copy_bps_limit = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_dd_blocksize = 1M {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_name_template = volume-%s {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_service_inithost_offload = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volume_usage_audit_period = month {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] zoning_mode = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_concurrency.disable_process_locking = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.admin_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.admin_token = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.admin_user = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_port = 35357 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_protocol = https {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_section = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_type = password {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_uri = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.auth_version = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.cache = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.identity_uri = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.include_service_catalog = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.interface = public {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_password = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcache_username = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.region_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.service_type = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83629) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 15:11:17 devstack cinder-volume[83629]: WARNING cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 15:11:17 devstack cinder-volume[83629]: WARNING cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.backend = dogpile.cache.null {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.backend_argument = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.backend_expiration_time = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.config_prefix = cache.oslo {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.debug_cache_backend = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.enable_retry_client = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.enable_socket_keepalive = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.enforce_fips_mode = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.expiration_time = 600 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Running cmd (subprocess): mount.quobyte {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.hashclient_retry_attempts = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_dead_retry = 300 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_pool_maxsize = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_sasl_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.proxies = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.redis_db = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.redis_server = localhost:6379 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.retry_attempts = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.retry_delay = 0.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.socket_keepalive_count = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.socket_keepalive_idle = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.socket_keepalive_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.socket_timeout = 1.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.tls_allowed_ciphers = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.tls_cafile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.tls_certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.tls_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.tls_keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cache.username = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] coordination.backend_url = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.asyncio_connection = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.asyncio_slave_connection = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.backend = sqlalchemy {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.connection = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.connection_debug = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.connection_parameters = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.connection_recycle_time = 3600 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.connection_trace = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.db_inc_retry_interval = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.db_max_retries = 20 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.db_max_retry_interval = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.db_retry_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.max_overflow = 50 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.max_pool_size = 5 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.max_retries = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.mysql_wsrep_sync_wait = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.pool_timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.retry_interval = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.slave_connection = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.sqlite_synchronous = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.synchronous_reader = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] database.use_db_reconnect = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.connection_string = messaging:// {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.es_doc_type = notification {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.es_scroll_size = 10000 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.es_scroll_time = 2m {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.filter_error_trace = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.hmac_keys = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.sentinel_service_name = mymaster {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.socket_timeout = 0.1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.trace_requests = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler.trace_sqlalchemy = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler_jaeger.process_tags = {} {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler_jaeger.service_name_prefix = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] profiler_otlp.service_name_prefix = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.enforce_new_defaults = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: WARNING oslo_config.cfg [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.enforce_scope = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.policy_default_rule = default {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.policy_file = policy.yaml {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.group = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.helper_command = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] privsep_osbrick.user = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.group = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.helper_command = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] cinder_sys_admin.user = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.auth_section = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.auth_type = password {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.cafile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.collect_timing = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.send_service_user_token = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.split_loggers = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] service_user.timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.auth_section = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.auth_type = password {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.collect_timing = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.region_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.split_loggers = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] glance.timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.backend_availability_zone = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.chap_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.chap_username = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.disk_geometry = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_client_cert = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_client_cert_key = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_data_namespace = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.driver_use_ssl = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.extra_capabilities = {} {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.filter_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.goodness_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iscsi_target_flags = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iscsi_write_cache = on {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iser_helper = tgtadm {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iser_port = 3260 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_host = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_login = admin {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_mount_options = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_private_key = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_share_path = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.num_shell_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.quobyte_volume_url = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.replication_device = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.report_discard_supported = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.reserved_percentage = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_helper = tgtadm {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_port = 3260 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_protocol = iscsi {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.trace_flags = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.unique_fqdn_network = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.use_chap_auth = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_backend_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_clear = zero {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_clear_ionice = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_clear_size = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_reports.file_event_handler = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_reports.log_dir = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.backend_availability_zone = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.backend_host = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.chap_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.chap_username = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.chiscsi_conf = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.disk_geometry = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_client_cert = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_data_namespace = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.driver_use_ssl = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.extra_capabilities = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.filter_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.goodness_function = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iser_helper = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iser_ip_address = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iser_port = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] CMD "mount.quobyte" returned: 1 in 0.101s {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.iser_target_prefix = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_host = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_login = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_mount_options = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_password = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_private_key = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_share_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=83629) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_ssh_port = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: INFO cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 ... Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 -c /etc/quobyte/client-cinder.cfg {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.num_shell_tries = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.nvmet_port_id = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.replication_device = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.report_discard_supported = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.reserved_percentage = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.scst_target_driver = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.storage_protocol = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_helper = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_ip_address = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_port = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_prefix = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_protocol = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.trace_flags = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.use_chap_auth = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_clear = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_clear_size = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] QuobyteHD.volumes_dir = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_notifications.driver = [] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_notifications.retry = -1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] key_manager.fixed_key = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.barbican_api_version = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.barbican_endpoint = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.barbican_endpoint_type = public {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.barbican_region_name = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.cafile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.collect_timing = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.number_of_retries = 60 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.retry_delay = 1 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.send_service_user_token = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.split_loggers = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.verify_ssl = True {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican.verify_ssl_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.auth_section = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.auth_type = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.cafile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.certfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.collect_timing = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.insecure = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.keyfile = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.split_loggers = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] barbican_service_user.timeout = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.approle_role_id = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.approle_secret_id = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.kv_mountpoint = secret {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.kv_path = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.kv_version = 2 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.namespace = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.root_token_id = **** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.ssl_ca_crt_file = None {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.timeout = 60.0 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.use_ssl = False {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:17 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] ******************************************************************************** {{(pid=83367) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 15:11:17 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 -c /etc/quobyte/client-cinder.cfg Apr 28 15:11:17 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:18 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:18 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.808s {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:18 devstack cinder-volume[83629]: INFO cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 succeeded Apr 28 15:11:18 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=83629) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:18 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.822s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:18 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:18 devstack sudo[83726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:18 devstack sudo[83726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:19 devstack sudo[83726]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.605s {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:19 devstack cinder-volume[83629]: INFO cinder.volume.driver [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.volume.driver [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6490058898926, 'free_capacity_gb': 1775.6490058898926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83629) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_db.sqlalchemy.engines [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG dbcounter [-] [83629] Writer thread running {{(pid=83629) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.db.sqlalchemy.api [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Building query based on filter {{(pid=83629) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.image.image_utils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83629) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 15:11:19 devstack cinder-volume[83629]: INFO cinder.keymgr.migration [None req-732ff550-e832-4c14-b8e2-4bc3588e9955 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=83629) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=83629) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:19 devstack sudo[83745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:19 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:19 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.647s {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Notifying Schedulers of capabilities ... {{(pid=83629) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:11:19 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Driver initialization completed successfully. Apr 28 15:11:19 devstack cinder-volume[83629]: INFO cinder.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Initiating service 3 cleanup Apr 28 15:11:19 devstack cinder-volume[83629]: INFO cinder.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Service 3 cleanup completed. Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.service [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Creating RPC server for service cinder-volume {{(pid=83629) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 15:11:19 devstack cinder-volume[83629]: DEBUG cinder.service [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83629) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 15:11:20 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=83629) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG cinder.volume.drivers.quobyte [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=83629) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83629) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:20 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:20 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:20 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:20 devstack cinder-volume[83629]: DEBUG oslo_concurrency.processutils [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.747s {{(pid=83629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:20 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-94fdcf9a-d69f-4851-88a3-018bdf1902f1 None None] Driver post RPC initialization completed successfully. Apr 28 15:11:24 devstack cinder-volume[83367]: INFO oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Caught SIGTERM, stopping children Apr 28 15:11:24 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Acquiring lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:24 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Acquired lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:24 devstack cinder-volume[83367]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Releasing lock "singleton_lock" {{(pid=83367) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:24 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Stop services. {{(pid=83367) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 15:11:24 devstack cinder-volume[83367]: DEBUG oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Killing children. {{(pid=83367) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 15:11:24 devstack cinder-volume[83367]: INFO oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Waiting on 1 children to exit Apr 28 15:11:24 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Acquiring lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:24 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Acquired lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:24 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Releasing lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:24 devstack cinder-volume[83629]: WARNING amqp [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 15:11:24 devstack cinder-volume[83629]: WARNING amqp [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 15:11:24 devstack cinder-volume[83367]: INFO oslo_service.backend._eventlet.service [None req-e5698da7-dd6c-42c0-8177-6e2936ffca46 None None] Child 83629 exited with status 0 Apr 28 15:11:27 devstack cinder-volume[83999]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 15:11:27 devstack cinder-volume[83999]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 15:11:27 devstack cinder-volume[83999]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 15:11:28 devstack cinder-volume[83999]: INFO dbcounter [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Registered counter for database cinder Apr 28 15:11:28 devstack cinder-volume[83999]: DEBUG oslo_db.sqlalchemy.engines [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG dbcounter [-] [83999] Writer thread running {{(pid=83999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:11:29 devstack cinder-volume[83999]: INFO cinder.rpc [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 15:11:29 devstack cinder-volume[83999]: INFO cinder.rpc [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_db.sqlalchemy.engines [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:29 devstack cinder-volume[83999]: INFO cinder.volume.manager [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Determined volume DB was empty at startup. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG cinder.volume.manager [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83999) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 15:11:29 devstack cinder-volume[83999]: WARNING stevedore.named [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 15:11:29 devstack cinder-volume[83999]: WARNING castellan.key_manager [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:11:29 devstack cinder-volume[83999]: WARNING cinder.keymgr.conf_key_mgr [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 15:11:29 devstack cinder-volume[83999]: INFO cinder.volume.manager [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_db.sqlalchemy.engines [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:29 devstack cinder-volume[83999]: INFO oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Starting 1 workers Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Started child 84270 {{(pid=83999) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Full set of CONF: {{(pid=83999) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] ******************************************************************************** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Configuration options gathered from: {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] ================================================================================ {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] allow_availability_zone_fallback = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] allow_compression_on_image_upload = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] allowed_direct_url_schemes = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[84270]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] api_rate_limit = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] auth_strategy = keystone {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_availability_zone = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_host = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_stats_polling_interval = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backup_api_class = cinder.backup.api.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backup_name_template = backup-%s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backup_use_same_host = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backup_use_temp_snapshot = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] chap_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] chap_username = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_internal_tenant_project_id = 2d39744aee1840acaa2e332e5f12305e {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_internal_tenant_user_id = 6c313bf3c094422b92c060715aa39b42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cluster = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] compression_format = gzip {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] compute_api_class = cinder.compute.nova.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] config_dir = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] config_source = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] control_exchange = openstack {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] debug = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] default_availability_zone = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] default_group_type = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] default_volume_type = QuobyteHD {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] disk_geometry = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_client_cert = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_client_cert_key = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_data_namespace = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_ssl_cert_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_ssl_cert_verify = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] driver_use_ssl = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] enable_new_services = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] enable_unsupported_driver = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] enabled_backends = ['QuobyteHD'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] enforce_multipath_for_image_xfer = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] filter_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_api_insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_api_ssl_compression = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_ca_certificates_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_catalog_info = image:glance:publicURL {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_num_retries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance_request_timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] goodness_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] graceful_shutdown_timeout = 5 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] group_api_class = cinder.group.api.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] host = devstack {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_compress_on_upload = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_conversion_address_space_limit = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_conversion_cpu_limit = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_conversion_disable = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_upload_use_cinder_backend = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_upload_use_internal_tenant = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_volume_cache_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_volume_cache_max_count = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] image_volume_cache_max_size_gb = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] init_host_max_objects_retrieval = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] instance_format = [instance: %(uuid)s] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iscsi_target_flags = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iscsi_write_cache = on {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iser_helper = tgtadm {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iser_ip_address = 192.168.122.42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iser_port = 3260 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84270) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_color = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_config_append = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_dir = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_options = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_rotate_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_rotate_interval_type = days {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] log_rotation_type = none {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] max_age = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] max_logfile_count = 30 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] max_logfile_size_mb = 200 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] max_over_subscription_ratio = 20.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] message_reap_interval = 86400 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] message_ttl = 2592000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] migration_create_volume_timeout_secs = 300 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] monkey_patch = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] monkey_patch_modules = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] my_ip = 192.168.122.42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] no_snapshot_gb_quota = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] num_iser_scan_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] num_shell_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] num_volume_device_scan_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] nvmeof_conn_info_version = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] nvmet_ns_id = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] nvmet_port_id = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_max_limit = 1000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_ext_list = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_listen_port = 8776 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_use_ssl = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] osapi_volume_workers = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] per_volume_size_limit = -1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] periodic_fuzzy_delay = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] periodic_interval = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] public_endpoint = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] publish_errors = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_backup_gigabytes = 1000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_backups = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_gigabytes = 1000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_groups = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_snapshots = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] quota_volumes = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] rate_limit_burst = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] rate_limit_except_level = CRITICAL {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] rate_limit_interval = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] reinit_driver_count = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] replication_device = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] report_discard_supported = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] report_interval = 120 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] reservation_clean_interval = 86400 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] reservation_expire = 86400 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] reserved_image_namespaces = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] reserved_percentage = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] rpc_response_timeout = 120 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] run_external_periodic_tasks = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] scst_target_driver = iscsi {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] scst_target_iqn_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_down_time = 720 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] shell_completion = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] snapshot_name_template = snapshot-%s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] split_loggers = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] state_path = /opt/stack/data/cinder {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] storage_availability_zone = nova {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] storage_protocol = iSCSI {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] syslog_log_facility = LOG_USER {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_helper = lioadm {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_ip_address = 192.168.122.42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_port = 3260 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_protocol = iscsi {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] target_secondary_ip_addresses = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] trace_flags = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] transport_url = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] until_refresh = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_chap_auth = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_default_quota_class = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_journal = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_json = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_multipath_for_image_xfer = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_stderr = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] use_syslog = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] verify_glance_signatures = enabled {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_api_class = cinder.volume.api.API {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_backend_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_clear = zero {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_clear_ionice = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_clear_size = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_copy_bps_limit = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_dd_blocksize = 1M {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84270) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_name_template = volume-%s {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_service_inithost_offload = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volume_usage_audit_period = month {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] zoning_mode = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 15:11:29 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 15:11:29 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Running cmd (subprocess): mount.quobyte {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_concurrency.disable_process_locking = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.admin_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.admin_token = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.admin_user = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_port = 35357 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_protocol = https {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_section = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_type = password {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_uri = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.auth_version = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.cache = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.identity_uri = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.include_service_catalog = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.interface = public {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_password = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcache_username = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.region_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.service_type = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.backend = dogpile.cache.null {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.backend_argument = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.backend_expiration_time = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.config_prefix = cache.oslo {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.debug_cache_backend = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.enable_retry_client = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.enable_socket_keepalive = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.enforce_fips_mode = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.expiration_time = 600 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.hashclient_retry_attempts = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_dead_retry = 300 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_pool_maxsize = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_sasl_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.proxies = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.redis_db = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.redis_server = localhost:6379 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.retry_attempts = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.retry_delay = 0.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.socket_keepalive_count = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.socket_keepalive_idle = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.socket_keepalive_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.socket_timeout = 1.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.tls_allowed_ciphers = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.tls_cafile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.tls_certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.tls_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.tls_keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cache.username = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] coordination.backend_url = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.asyncio_connection = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.asyncio_slave_connection = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.backend = sqlalchemy {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.connection = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.connection_debug = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.connection_parameters = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.connection_recycle_time = 3600 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.connection_trace = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.db_inc_retry_interval = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.db_max_retries = 20 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.db_max_retry_interval = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.db_retry_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.max_overflow = 50 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.max_pool_size = 5 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.max_retries = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.mysql_wsrep_sync_wait = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.pool_timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.retry_interval = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.slave_connection = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.sqlite_synchronous = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.synchronous_reader = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] database.use_db_reconnect = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.connection_string = messaging:// {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.es_doc_type = notification {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.es_scroll_size = 10000 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.es_scroll_time = 2m {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.filter_error_trace = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.hmac_keys = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.sentinel_service_name = mymaster {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.socket_timeout = 0.1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.trace_requests = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler.trace_sqlalchemy = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler_jaeger.process_tags = {} {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler_jaeger.service_name_prefix = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] profiler_otlp.service_name_prefix = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.enforce_new_defaults = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: WARNING oslo_config.cfg [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.enforce_scope = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.policy_default_rule = default {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.policy_file = policy.yaml {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.group = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.helper_command = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] privsep_osbrick.user = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.group = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.helper_command = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] cinder_sys_admin.user = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.auth_section = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.auth_type = password {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.cafile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.collect_timing = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.send_service_user_token = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.split_loggers = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] service_user.timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.auth_section = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.auth_type = password {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.collect_timing = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.region_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.split_loggers = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] glance.timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.backend_availability_zone = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.chap_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack quobyte-client[84276]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 15:11:29 devstack quobyte-client[84276]: Invalid parameters found, error: missing mount point. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.chap_username = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.disk_geometry = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack quobyte-client[84276]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_client_cert = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack quobyte-client[84276]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_client_cert_key = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_data_namespace = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.driver_use_ssl = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.extra_capabilities = {} {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.filter_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.goodness_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] CMD "mount.quobyte" returned: 1 in 0.186s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iscsi_target_flags = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iscsi_write_cache = on {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iser_helper = tgtadm {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iser_port = 3260 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_host = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_login = admin {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_mount_options = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_private_key = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_share_path = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:29 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.num_shell_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.quobyte_volume_url = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.replication_device = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.report_discard_supported = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.reserved_percentage = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_helper = tgtadm {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_port = 3260 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_protocol = iscsi {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.trace_flags = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.unique_fqdn_network = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.use_chap_auth = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_backend_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_clear = zero {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack sudo[84277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_clear_ionice = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_clear_size = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack sudo[84277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_reports.file_event_handler = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_reports.log_dir = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.backend_availability_zone = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.backend_host = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.chap_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.chap_username = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.chiscsi_conf = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.disk_geometry = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_client_cert = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_data_namespace = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.driver_use_ssl = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.extra_capabilities = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.filter_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.goodness_function = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iser_helper = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iser_ip_address = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iser_port = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.iser_target_prefix = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_host = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_login = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_mount_options = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_password = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_private_key = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_share_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_ssh_port = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.num_shell_tries = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.nvmet_port_id = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.replication_device = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.report_discard_supported = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.reserved_percentage = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.scst_target_driver = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.storage_protocol = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_helper = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_ip_address = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_port = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_prefix = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_protocol = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.trace_flags = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.use_chap_auth = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_clear = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_clear_size = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] QuobyteHD.volumes_dir = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_notifications.driver = [] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_notifications.retry = -1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] key_manager.fixed_key = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.barbican_api_version = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.barbican_endpoint = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.barbican_endpoint_type = public {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.barbican_region_name = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.cafile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.collect_timing = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.number_of_retries = 60 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.retry_delay = 1 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.send_service_user_token = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.split_loggers = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.verify_ssl = True {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican.verify_ssl_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.auth_section = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.auth_type = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.cafile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.certfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.collect_timing = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.insecure = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.keyfile = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.split_loggers = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] barbican_service_user.timeout = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.approle_role_id = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.approle_secret_id = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.kv_mountpoint = secret {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.kv_path = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.kv_version = 2 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.namespace = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.root_token_id = **** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.ssl_ca_crt_file = None {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.timeout = 60.0 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.use_ssl = False {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 15:11:30 devstack cinder-volume[83999]: DEBUG oslo_service.backend._eventlet.service [None req-6da1693b-927e-4d6f-901a-134ef03bc838 None None] ******************************************************************************** {{(pid=83999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 15:11:30 devstack sudo[84277]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.822s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:30 devstack cinder-volume[84270]: INFO cinder.volume.driver [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG cinder.volume.driver [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.651741027832, 'free_capacity_gb': 1775.651741027832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84270) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_db.sqlalchemy.engines [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writer thread running {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG cinder.db.sqlalchemy.api [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Building query based on filter {{(pid=84270) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84270) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:30 devstack cinder-volume[84270]: INFO cinder.keymgr.migration [None req-98151f4b-8802-4d82-a10e-b32526250a5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 15:11:30 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:30 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:31 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.806s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:11:31 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Driver initialization completed successfully. Apr 28 15:11:31 devstack cinder-volume[84270]: INFO cinder.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Initiating service 3 cleanup Apr 28 15:11:31 devstack cinder-volume[84270]: INFO cinder.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Service 3 cleanup completed. Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG cinder.service [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Creating RPC server for service cinder-volume {{(pid=84270) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG cinder.service [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84270) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 15:11:31 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:11:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:11:31 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:11:31 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:11:32 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Apr 28 15:11:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.580s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:11:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f7e582f1-9ddb-4918-b518-5ccf06d53288 None None] Driver post RPC initialization completed successfully. Apr 28 15:11:39 devstack cinder-volume[83999]: DEBUG dbcounter [-] [83999] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:11:41 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:11:42 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=4 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:11:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-eb75df04-3ee0-40da-b724-220217932d3e tempest-BackendsCapabilitiesAdminTestsJSON-1048923338 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.651741027832, 'free_capacity_gb': 1775.651741027832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84270) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 15:11:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ebb38135-2599-4901-85ed-323f6103936c tempest-BackendsCapabilitiesAdminTestsJSON-1048923338 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.651741027832, 'free_capacity_gb': 1775.651741027832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84270) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 15:12:30 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:12:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Flow 'volume_create_manager' (05dc6e8f-0afa-42d2-8548-fb5b52cda92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f3997-623b-451c-b93e-c93ded5d94da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f3997-623b-451c-b93e-c93ded5d94da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1299511580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0db713-9f86-4841-aa33-09d58de08d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc609fa528e40de863ee195ae9b04a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:31Z,use_quota=True,user_id='4715dcdab84641f5b03d48f150116bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a242e902-5ca9-4edd-9921-408b85b492e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a242e902-5ca9-4edd-9921-408b85b492e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46755a7b-aef3-4ef3-82be-03258e68972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46755a7b-aef3-4ef3-82be-03258e68972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0db713-9f86-4841-aa33-09d58de08d64', 'volume_name': 'volume-ff0db713-9f86-4841-aa33-09d58de08d64', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b1d054-0f9c-4531-91bb-b5a3d7964be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b1d054-0f9c-4531-91bb-b5a3d7964be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad9aae1-0ea7-4e04-befc-7733864bf74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:31 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Volume ff0db713-9f86-4841-aa33-09d58de08d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0db713-9f86-4841-aa33-09d58de08d64', 'volume_size': 1} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1299511580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0db713-9f86-4841-aa33-09d58de08d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc609fa528e40de863ee195ae9b04a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:31Z,use_quota=True,user_id='4715dcdab84641f5b03d48f150116bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Creating volume ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:12:31 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:12:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:31 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 1073741824 Apr 28 15:12:31 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:32 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 1073741824" returned: 0 in 1.242s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:32 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 Apr 28 15:12:32 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Flow 'volume_create_manager' (ee981aaf-ccdc-4933-b7a8-abcb37c1755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e247aa4-b245-4db1-b3e6-ed4d1b7a0105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e247aa4-b245-4db1-b3e6-ed4d1b7a0105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-59158119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf72778-898c-47d2-9a32-6c3c804a3593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700baea76ef24286b314b77a6d2052b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:33Z,use_quota=True,user_id='3f2b0f10fd754245a9d6aeae9f5f2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc752647-6205-44a6-aef0-72cdab3281ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc752647-6205-44a6-aef0-72cdab3281ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34ad25b-326f-4a3f-88a2-5413dfd453f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34ad25b-326f-4a3f-88a2-5413dfd453f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf72778-898c-47d2-9a32-6c3c804a3593', 'volume_name': 'volume-2bf72778-898c-47d2-9a32-6c3c804a3593', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d824bd5-4a67-42f2-a7b0-d7258ba1842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d824bd5-4a67-42f2-a7b0-d7258ba1842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8768ba-5bb5-49d1-a842-1882bc44ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume 2bf72778-898c-47d2-9a32-6c3c804a3593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf72778-898c-47d2-9a32-6c3c804a3593', 'volume_size': 1} Apr 28 15:12:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:33 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64" returned: 0 in 0.739s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-59158119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf72778-898c-47d2-9a32-6c3c804a3593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700baea76ef24286b314b77a6d2052b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:33Z,use_quota=True,user_id='3f2b0f10fd754245a9d6aeae9f5f2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Creating volume 2bf72778-898c-47d2-9a32-6c3c804a3593 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:12:33 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:33 devstack sudo[84831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 1073741824 Apr 28 15:12:33 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad9aae1-0ea7-4e04-befc-7733864bf74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0db713-9f86-4841-aa33-09d58de08d64', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4c1817-7c49-4a0a-8c2c-2f0b1951cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:33 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Volume volume-ff0db713-9f86-4841-aa33-09d58de08d64 (ff0db713-9f86-4841-aa33-09d58de08d64): created successfully Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4c1817-7c49-4a0a-8c2c-2f0b1951cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Flow 'volume_create_manager' (05dc6e8f-0afa-42d2-8548-fb5b52cda92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:33 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-68fd591f-1dde-44e6-ad1f-dece58ea004c req-98bfa8f5-3e9e-4b84-8f3d-d89d784b9966 tempest-VolumesSnapshotsTestJSON-1364814073 None] Created volume successfully. Apr 28 15:12:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:35 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 1073741824" returned: 0 in 2.229s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:35 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 Apr 28 15:12:35 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:36 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593" returned: 0 in 0.932s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] <== create_volume: return (3279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.282s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.382s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8768ba-5bb5-49d1-a842-1882bc44ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf72778-898c-47d2-9a32-6c3c804a3593', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552ae7df-acda-40a7-b33c-8b7c157945d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Creating offline snapshot 92a5ee20-1ef4-4bd6-afed-5c37dd16a361 of volume ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:12:36 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcr_ej790/privsep.sock'] Apr 28 15:12:36 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume volume-2bf72778-898c-47d2-9a32-6c3c804a3593 (2bf72778-898c-47d2-9a32-6c3c804a3593): created successfully Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552ae7df-acda-40a7-b33c-8b7c157945d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Flow 'volume_create_manager' (ee981aaf-ccdc-4933-b7a8-abcb37c1755c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:36 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcr_ej790/privsep.sock Apr 28 15:12:36 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:36 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ecacdeb9-dbe4-438e-a361-c07d572460b6 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Created volume successfully. Apr 28 15:12:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "cinder-2bf72778-898c-47d2-9a32-6c3c804a3593-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "cinder-2bf72778-898c-47d2-9a32-6c3c804a3593-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "cinder-quobyte-2bf72778-898c-47d2-9a32-6c3c804a3593" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "cinder-quobyte-2bf72778-898c-47d2-9a32-6c3c804a3593" acquired by "delete_volume" :: waited 0.054s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Flow 'volume_create_manager' (8b63d56b-503f-4e6d-8cca-105c6418a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba3189e-fdfc-441f-a790-5516a915ab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba3189e-fdfc-441f-a790-5516a915ab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-665010204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c328de3-2913-4d66-b7f3-e3a9b89e7ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d6b2dcb1b4f30ba977dd07b1d9bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:39Z,use_quota=True,user_id='01f5a465baea4cc6aa18dd8baec0d046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab90f7a-9af2-49ea-939f-af79006f4050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab90f7a-9af2-49ea-939f-af79006f4050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285e6bc5-9f9c-49a3-884c-63314b961814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285e6bc5-9f9c-49a3-884c-63314b961814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c328de3-2913-4d66-b7f3-e3a9b89e7ad4', 'volume_name': 'volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2e98c8-5237-401e-99d1-08c30003a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2e98c8-5237-401e-99d1-08c30003a772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8829882-c723-4738-884d-4c397466294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Volume 8c328de3-2913-4d66-b7f3-e3a9b89e7ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4', 'volume_size': 1} Apr 28 15:12:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:39 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:39 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Spawned new privsep daemon via rootwrap Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Accepted privsep connection to /tmp/tmpcr_ej790/privsep.sock {{(pid=84270) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 28 15:12:39 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 28 15:12:39 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 28 15:12:39 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 28 15:12:39 devstack cinder-volume[84270]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84876 Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f030c58-f5f5-44bc-a661-d500eabdc013]: (2,) {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:39 devstack cinder-volume[84270]: WARNING oslo_privsep.priv_context [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] privsep daemon already running Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d6c27-1dbf-468e-8c65-c8caf4e53ed9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703f23e-caf4-4d9d-af27-8c6efee1bc72]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:39 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 Apr 28 15:12:39 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 Apr 28 15:12:39 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:39 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:40 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593" returned: 0 in 1.311s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:40 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593 Apr 28 15:12:40 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:40 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64" returned: 0 in 1.402s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:40 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 1G Apr 28 15:12:40 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:41 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2bf72778-898c-47d2-9a32-6c3c804a3593" returned: 0 in 1.154s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "cinder-quobyte-2bf72778-898c-47d2-9a32-6c3c804a3593" released by "delete_volume" :: held 4.060s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:42 devstack cinder-volume[84270]: WARNING cinder.quota [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:12:42 devstack cinder-volume[84270]: WARNING cinder.quota [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Created reservations ['87cc1af0-6bee-48bc-a376-472dd711daf0', '0f324e7a-8e99-4028-8b27-ba620692d9b8', 'f2a49cd1-0ab0-44a7-9939-75a5d3f5d9a5', 'd1454849-209e-4fa5-8dd2-6f9f36b922b0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:12:42 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 1G" returned: 0 in 1.394s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0db713-9f86-4841-aa33-09d58de08d64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:42 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0db713-9f86-4841-aa33-09d58de08d64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 Apr 28 15:12:42 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:42 devstack sudo[84935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:12:42 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:43 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0db713-9f86-4841-aa33-09d58de08d64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361" returned: 0 in 1.001s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:43 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 is being set with open permissions: ugo+rw Apr 28 15:12:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:43 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 Apr 28 15:12:43 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:43 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.105s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:43 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:12:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Deleted volume successfully. Apr 28 15:12:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-919c9476-83bc-4417-8861-b60e04bf35d2 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "cinder-2bf72778-898c-47d2-9a32-6c3c804a3593-delete_volume" released by "delete_volume" :: held 5.844s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:44 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361" returned: 0 in 0.977s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Flow 'volume_create_manager' (6ca64400-5b64-4c20-bca9-126ae0161a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31b4d2f-5532-443f-8ed5-4001474ef61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31b4d2f-5532-443f-8ed5-4001474ef61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98749808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861889d-7fdf-4021-9d8f-4ff594a1c648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700baea76ef24286b314b77a6d2052b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:44Z,use_quota=True,user_id='3f2b0f10fd754245a9d6aeae9f5f2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817f0c51-97a5-48bf-8d6b-1bfc541d3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817f0c51-97a5-48bf-8d6b-1bfc541d3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8892272-5a67-4b26-920f-2a5e190a6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8892272-5a67-4b26-920f-2a5e190a6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3861889d-7fdf-4021-9d8f-4ff594a1c648', 'volume_name': 'volume-3861889d-7fdf-4021-9d8f-4ff594a1c648', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048167c-138a-4266-9cb2-b3515ff8c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048167c-138a-4266-9cb2-b3515ff8c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f321d0-ec98-4067-8ff7-68bf711d2101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume 3861889d-7fdf-4021-9d8f-4ff594a1c648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3861889d-7fdf-4021-9d8f-4ff594a1c648', 'volume_size': 1} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:44 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info Apr 28 15:12:44 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:45 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info" returned: 0 in 0.734s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:45 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info is being set with open permissions: ugo+rw Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:45 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info Apr 28 15:12:45 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:45 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.info" returned: 0 in 0.686s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.452s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.206s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-665010204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c328de3-2913-4d66-b7f3-e3a9b89e7ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d6b2dcb1b4f30ba977dd07b1d9bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:39Z,use_quota=True,user_id='01f5a465baea4cc6aa18dd8baec0d046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Creating volume 8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:12:45 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:12:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:45 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 1073741824 Apr 28 15:12:45 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-44a0ff9b-35fb-4894-999b-bf8f0b94042e req-97f880fe-20ee-49eb-bda8-52410919e264 tempest-VolumesSnapshotsTestJSON-1364814073 None] Create snapshot completed successfully Apr 28 15:12:46 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 1073741824" returned: 0 in 0.915s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:46 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 Apr 28 15:12:46 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "cinder-92a5ee20-1ef4-4bd6-afed-5c37dd16a361-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-92a5ee20-1ef4-4bd6-afed-5c37dd16a361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "cinder-quobyte-92a5ee20-1ef4-4bd6-afed-5c37dd16a361" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-92a5ee20-1ef4-4bd6-afed-5c37dd16a361" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Deleting offline snapshot 92a5ee20-1ef4-4bd6-afed-5c37dd16a361 of volume ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] snapshot_file for this snap is: volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b55f7-62cf-4dec-95c9-a7f615e9c304]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:47 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 Apr 28 15:12:47 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:47 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" returned: 0 in 0.807s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98749808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861889d-7fdf-4021-9d8f-4ff594a1c648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700baea76ef24286b314b77a6d2052b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:12:44Z,use_quota=True,user_id='3f2b0f10fd754245a9d6aeae9f5f2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Creating volume 3861889d-7fdf-4021-9d8f-4ff594a1c648 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:12:47 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8829882-c723-4738-884d-4c397466294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078a9191-cffd-4d51-8064-93c0bb0c5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:47 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 1073741824 Apr 28 15:12:47 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:47 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Volume volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 (8c328de3-2913-4d66-b7f3-e3a9b89e7ad4): created successfully Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078a9191-cffd-4d51-8064-93c0bb0c5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Flow 'volume_create_manager' (8b63d56b-503f-4e6d-8cca-105c6418a73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:47 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5d4c346a-cfe3-4e38-a1ff-76369104f79a tempest-VolumesAdminNegativeTest-354305504 None] Created volume successfully. Apr 28 15:12:48 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361" returned: 0 in 1.100s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff0db713-9f86-4841-aa33-09d58de08d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:12:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[069939e6-3ee9-4721-b7a7-cfccdecd506b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:48 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 Apr 28 15:12:48 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:48 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 1073741824" returned: 0 in 1.236s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:49 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 Apr 28 15:12:49 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:49 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64" returned: 0 in 0.895s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Acquiring lock "cinder-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:49 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 Apr 28 15:12:49 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "cinder-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Acquiring lock "cinder-quobyte-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "cinder-quobyte-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230317c-8d88-41bc-9693-5d2e428714b6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:49 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 Apr 28 15:12:49 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:49 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f321d0-ec98-4067-8ff7-68bf711d2101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3861889d-7fdf-4021-9d8f-4ff594a1c648', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675620d9-f9f1-4f8a-9f2c-220a6221d93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:12:49 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Volume volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 (3861889d-7fdf-4021-9d8f-4ff594a1c648): created successfully Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675620d9-f9f1-4f8a-9f2c-220a6221d93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:12:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Flow 'volume_create_manager' (6ca64400-5b64-4c20-bca9-126ae0161a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:12:49 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e6e4f72e-14eb-42d8-a4f0-3247ace58c38 tempest-VolumeQuotasAdminTestJSON-1105647335 None] Created volume successfully. Apr 28 15:12:50 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361" returned: 0 in 0.795s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:50 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361 Apr 28 15:12:50 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:50 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" returned: 0 in 0.804s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:50 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4 Apr 28 15:12:50 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:50 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:12:50 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:51 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64.92a5ee20-1ef4-4bd6-afed-5c37dd16a361" returned: 0 in 0.779s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-92a5ee20-1ef4-4bd6-afed-5c37dd16a361" released by "_delete_snapshot" :: held 3.732s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" released by "delete_snapshot" :: held 3.820s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:51 devstack cinder-volume[84270]: WARNING cinder.quota [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.quota [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Created reservations ['b579474c-104a-4f5f-b2a0-81930a6068cc', 'c78801fa-e285-4538-94c8-8e47e8049fc6', 'bbe2383a-bad1-4580-b49b-9d40c298339d', '60707cf2-80e0-47f7-a05a-fb27802e13e5'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:12:51 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Delete snapshot completed successfully. Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-ea250178-4d63-4a8f-b1ce-3a3f93c5db06 req-65e94cb1-5c02-4c5e-8670-f73d564b2551 tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-92a5ee20-1ef4-4bd6-afed-5c37dd16a361-delete_snapshot" released by "delete_snapshot" :: held 4.046s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:51 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.856s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:12:51 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" returned: 0 in 1.026s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "cinder-quobyte-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4" released by "delete_volume" :: held 1.888s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Created reservations ['34e3bdce-f92a-488c-93e4-8d25136dc1d1', '79878abe-ed1c-4b36-b457-30e0f800e8a3', '2fa4c727-af90-4e20-a71e-0295aa6b418a', 'dbd58950-d13f-49c0-b677-2347cea32f12'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:51 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:12:51 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "cinder-ff0db713-9f86-4841-aa33-09d58de08d64-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-ff0db713-9f86-4841-aa33-09d58de08d64-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" acquired by "delete_volume" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994f664-af5d-4e8c-be03-41714a5f3b2b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-69fb1373-3a30-401f-9419-9ebf1f380481 tempest-VolumeQuotasAdminTestJSON-1579712573 None] Transfer volume completed successfully. Apr 28 15:12:52 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 Apr 28 15:12:52 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:52 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.943s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:12:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Deleted volume successfully. Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d28010c6-d4bb-41aa-bf19-b76e02a890f8 tempest-VolumesAdminNegativeTest-354305504 None] Lock "cinder-8c328de3-2913-4d66-b7f3-e3a9b89e7ad4-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:52 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64" returned: 0 in 0.880s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:52 devstack sudo[85042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64 Apr 28 15:12:52 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Acquiring lock "cinder-3861889d-7fdf-4021-9d8f-4ff594a1c648-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "cinder-3861889d-7fdf-4021-9d8f-4ff594a1c648-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Acquiring lock "cinder-quobyte-3861889d-7fdf-4021-9d8f-4ff594a1c648" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "cinder-quobyte-3861889d-7fdf-4021-9d8f-4ff594a1c648" acquired by "delete_volume" :: waited 0.092s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d476e-3c3d-4247-8360-d49752d1b2c5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:53 devstack sudo[85061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 Apr 28 15:12:53 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:53 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ff0db713-9f86-4841-aa33-09d58de08d64" returned: 0 in 0.901s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-quobyte-ff0db713-9f86-4841-aa33-09d58de08d64" released by "delete_volume" :: held 1.895s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:53 devstack cinder-volume[84270]: DEBUG cinder.quota [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Created reservations ['8caa415c-11fd-40b6-aa3e-3e602cfd05ae', 'b2926327-3b2a-4503-9451-82e5b51b5c74', '6209d1aa-91e7-482b-958f-f8286d13d5f7', 'c3c9ef77-8b18-45d0-9083-6139d28e239b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:54 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:12:54 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:54 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648" returned: 0 in 1.144s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:54 devstack sudo[85091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648 Apr 28 15:12:54 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:54 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.913s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:54 devstack cinder-volume[84270]: DEBUG cinder.manager [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:12:54 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Deleted volume successfully. Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-3bd855b1-3ebe-4201-9b25-5d3e148af7b3 req-72369120-4b6f-428a-92c4-62cdee3fbc8e tempest-VolumesSnapshotsTestJSON-1364814073 None] Lock "cinder-ff0db713-9f86-4841-aa33-09d58de08d64-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:55 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3861889d-7fdf-4021-9d8f-4ff594a1c648" returned: 0 in 0.835s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "cinder-quobyte-3861889d-7fdf-4021-9d8f-4ff594a1c648" released by "delete_volume" :: held 2.078s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Created reservations ['def432a5-2ea3-400e-a31e-1281d16a24b8', '37e42f48-151c-452b-9f24-22ffd2aec6f8', '7dceffd2-219e-4e06-b380-4850381cbc9e', '02df2f32-e123-4fab-b81d-ddf1652083ba'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:12:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:12:55 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:12:55 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:12:56 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 28 15:12:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.672s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:12:56 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:12:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Deleted volume successfully. Apr 28 15:12:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33d2e569-6b03-43b7-8209-80ac80532a72 tempest-VolumeQuotasAdminTestJSON-314395766 None] Lock "cinder-3861889d-7fdf-4021-9d8f-4ff594a1c648-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:12:59 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Flow 'volume_create_manager' (16d4691c-ac53-45ef-bf3d-970d3374071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c034be3-a20d-43a3-9ced-6f943c328c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c034be3-a20d-43a3-9ced-6f943c328c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-34186022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affaaa79-6a51-4b84-8d93-7ce4f625f854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16f4ccf3f8914f968108c66db6f59068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:00Z,use_quota=True,user_id='c462b34d9d184a9bb1bd85c976dd1b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24817343-fffe-441c-a5f9-72af12e0ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24817343-fffe-441c-a5f9-72af12e0ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3559ab-376c-4df5-b0d5-c2b159eb2c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3559ab-376c-4df5-b0d5-c2b159eb2c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affaaa79-6a51-4b84-8d93-7ce4f625f854', 'volume_name': 'volume-affaaa79-6a51-4b84-8d93-7ce4f625f854', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136e3ba-1911-4795-8dc0-0d926472a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136e3ba-1911-4795-8dc0-0d926472a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb817d44-bc9e-48c9-8993-371dee75da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:00 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Volume affaaa79-6a51-4b84-8d93-7ce4f625f854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affaaa79-6a51-4b84-8d93-7ce4f625f854', 'volume_size': 1} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-34186022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affaaa79-6a51-4b84-8d93-7ce4f625f854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16f4ccf3f8914f968108c66db6f59068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:00Z,use_quota=True,user_id='c462b34d9d184a9bb1bd85c976dd1b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Creating volume affaaa79-6a51-4b84-8d93-7ce4f625f854 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:00 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:00 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 1073741824 Apr 28 15:13:00 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:01 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 1073741824" returned: 0 in 0.972s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:01 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 Apr 28 15:13:01 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:01 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb817d44-bc9e-48c9-8993-371dee75da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affaaa79-6a51-4b84-8d93-7ce4f625f854', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b9c3c-0d23-4fcb-b0a9-b33de1242852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Volume volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 (affaaa79-6a51-4b84-8d93-7ce4f625f854): created successfully Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b9c3c-0d23-4fcb-b0a9-b33de1242852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Flow 'volume_create_manager' (16d4691c-ac53-45ef-bf3d-970d3374071b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-dea57a59-200f-4cff-9c77-eae620aa0cd4 req-b60037e2-aaca-4e2b-b6bf-fb3529141640 tempest-VolumesGetTestJSON-1370734097 None] Created volume successfully. Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Acquiring lock "cinder-affaaa79-6a51-4b84-8d93-7ce4f625f854-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "cinder-affaaa79-6a51-4b84-8d93-7ce4f625f854-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Acquiring lock "cinder-quobyte-affaaa79-6a51-4b84-8d93-7ce4f625f854" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "cinder-quobyte-affaaa79-6a51-4b84-8d93-7ce4f625f854" acquired by "delete_volume" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[254167c4-dc8f-43df-8cb8-f2113330e7a6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:03 devstack sudo[85115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 Apr 28 15:13:03 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:03 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854" returned: 0 in 0.835s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:03 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854 Apr 28 15:13:03 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:04 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-affaaa79-6a51-4b84-8d93-7ce4f625f854" returned: 0 in 0.700s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "cinder-quobyte-affaaa79-6a51-4b84-8d93-7ce4f625f854" released by "delete_volume" :: held 1.605s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG cinder.quota [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Created reservations ['f19a52b9-dd2a-4b4c-9a19-d66ba64b28d8', '287440a3-a4d6-4d84-8959-c57c11fe6738', '23c9e89f-aaf2-4e1a-8910-2fb3ddaf8a4b', 'fabc6037-bd61-4cf1-9b5e-b4b832181cfa'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:04 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:04 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:05 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.917s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:05 devstack cinder-volume[84270]: DEBUG cinder.manager [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Deleted volume successfully. Apr 28 15:13:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-2cf3f5ea-4ff6-401d-afcb-42dcd550bda0 req-8fe04c35-f6bf-4dda-aabb-4d65b495bc5b tempest-VolumesGetTestJSON-1370734097 None] Lock "cinder-affaaa79-6a51-4b84-8d93-7ce4f625f854-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (ce7c74d0-3364-425e-8c24-fae29266f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae48dfb-6dfc-4a93-956f-9bae38a49f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae48dfb-6dfc-4a93-956f-9bae38a49f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1566552518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f946522c-01eb-4a0a-9ab6-59d764c605b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:10Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264ede21-1dbe-40f5-97f6-34f686981c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264ede21-1dbe-40f5-97f6-34f686981c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188841a4-8d07-4c7c-a7e6-23cc1034c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188841a4-8d07-4c7c-a7e6-23cc1034c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f946522c-01eb-4a0a-9ab6-59d764c605b5', 'volume_name': 'volume-f946522c-01eb-4a0a-9ab6-59d764c605b5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779957c-dffd-4629-baba-b0b0ec769818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779957c-dffd-4629-baba-b0b0ec769818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8a2048-ee5d-4828-ac7a-327892eee530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:10 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Volume f946522c-01eb-4a0a-9ab6-59d764c605b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f946522c-01eb-4a0a-9ab6-59d764c605b5', 'volume_size': 1} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1566552518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f946522c-01eb-4a0a-9ab6-59d764c605b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:10Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Creating volume f946522c-01eb-4a0a-9ab6-59d764c605b5 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:10 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:10 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 1073741824 Apr 28 15:13:10 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:11 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 1073741824" returned: 0 in 1.031s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:11 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 Apr 28 15:13:11 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:11 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5" returned: 0 in 0.700s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8a2048-ee5d-4828-ac7a-327892eee530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f946522c-01eb-4a0a-9ab6-59d764c605b5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc75f55b-b42f-49d2-b83e-eda9dbab42e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:11 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Volume volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 (f946522c-01eb-4a0a-9ab6-59d764c605b5): created successfully Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc75f55b-b42f-49d2-b83e-eda9dbab42e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (ce7c74d0-3364-425e-8c24-fae29266f214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:11 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8ac002f2-bf5f-4313-a052-bd10d31d26e9 tempest-VolumesTestJSON-341242922 None] Created volume successfully. Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (6742a620-debe-45ba-bd4b-07195b1bd3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810a014b-e45e-43df-8581-8d9a6f52fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810a014b-e45e-43df-8581-8d9a6f52fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-59958980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85616c2e-1fe5-4cc1-99f9-de83ab66a8c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:13Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9dd917-e79c-4288-aeea-26c9cd2829f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9dd917-e79c-4288-aeea-26c9cd2829f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a44bc1-7d89-4bef-b86a-2dfcc776354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a44bc1-7d89-4bef-b86a-2dfcc776354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85616c2e-1fe5-4cc1-99f9-de83ab66a8c7', 'volume_name': 'volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d99046-04c1-48b7-a00e-7805becda95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d99046-04c1-48b7-a00e-7805becda95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f366319a-e9e9-493f-8c28-7fd1b7588b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:12 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Volume 85616c2e-1fe5-4cc1-99f9-de83ab66a8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7', 'volume_size': 1} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-59958980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85616c2e-1fe5-4cc1-99f9-de83ab66a8c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:13Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Creating volume 85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:12 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:12 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 1073741824 Apr 28 15:13:12 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:13 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 1073741824" returned: 0 in 0.992s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:13 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 Apr 28 15:13:13 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:14 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" returned: 0 in 0.727s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f366319a-e9e9-493f-8c28-7fd1b7588b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b084dd8d-dae8-41c5-8370-8fdd5681d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:14 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Volume volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 (85616c2e-1fe5-4cc1-99f9-de83ab66a8c7): created successfully Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b084dd8d-dae8-41c5-8370-8fdd5681d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (6742a620-debe-45ba-bd4b-07195b1bd3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ac6bb43f-3251-40f7-a479-eefb16a675cd tempest-VolumesTestJSON-341242922 None] Created volume successfully. Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (79aa3f9a-11e0-4e5c-b545-d119010a6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db9f8f8-4246-49c8-af0a-87380b222a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db9f8f8-4246-49c8-af0a-87380b222a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431083143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11889d3b-fcde-459b-9373-73cc3d473034,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:15Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c81366b-245b-49a7-9e8d-6da48fb958f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c81366b-245b-49a7-9e8d-6da48fb958f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc126fb2-f709-48fc-bf81-8ae83d20b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc126fb2-f709-48fc-bf81-8ae83d20b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11889d3b-fcde-459b-9373-73cc3d473034', 'volume_name': 'volume-11889d3b-fcde-459b-9373-73cc3d473034', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2e278e-7168-4be0-87ac-99e23ee4dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2e278e-7168-4be0-87ac-99e23ee4dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b0354c-d990-40a5-99eb-21753eb3cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:15 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Volume 11889d3b-fcde-459b-9373-73cc3d473034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11889d3b-fcde-459b-9373-73cc3d473034', 'volume_size': 1} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431083143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11889d3b-fcde-459b-9373-73cc3d473034,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9d78b5efbfb45f38f9f90569e5928a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:15Z,use_quota=True,user_id='64bf1956b7b34d358b31e9298f7805fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Creating volume 11889d3b-fcde-459b-9373-73cc3d473034 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:15 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:15 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 1073741824 Apr 28 15:13:15 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:16 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 1073741824" returned: 0 in 1.103s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:16 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 Apr 28 15:13:16 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:16 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Flow 'volume_create_manager' (de602a90-d7e0-455f-9162-8ec567022f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7148d5-3399-4adf-b8b6-192843ed1fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7148d5-3399-4adf-b8b6-192843ed1fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-120063041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cabd25c-3861-410b-a6ea-c8e1d460551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edbf8c645ee455781fffa33fc761e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:17Z,use_quota=True,user_id='a81e06d6eb884e15a90db3c429152582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29aa21-88a3-4e29-afb0-8470ee14a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29aa21-88a3-4e29-afb0-8470ee14a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d2d4af-e276-410e-9269-ec3ca0289361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.image.glance [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Creating Keystone auth plugin from conf {{(pid=84270) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 15:13:17 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034" returned: 0 in 0.733s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b0354c-d990-40a5-99eb-21753eb3cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11889d3b-fcde-459b-9373-73cc3d473034', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f248f1-561d-4102-9116-c4e7317dafb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Volume volume-11889d3b-fcde-459b-9373-73cc3d473034 (11889d3b-fcde-459b-9373-73cc3d473034): created successfully Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f248f1-561d-4102-9116-c4e7317dafb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Flow 'volume_create_manager' (79aa3f9a-11e0-4e5c-b545-d119010a6d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-067a1ae6-71c3-4cb2-9472-15cdd6c8e663 tempest-VolumesTestJSON-341242922 None] Created volume successfully. Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d2d4af-e276-410e-9269-ec3ca0289361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9cabd25c-3861-410b-a6ea-c8e1d460551b', 'volume_name': 'volume-9cabd25c-3861-410b-a6ea-c8e1d460551b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823c40b4-d600-420f-a7d4-eb696d091f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823c40b4-d600-420f-a7d4-eb696d091f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a5df35-c92b-475f-9112-d54c2bc663cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Volume 9cabd25c-3861-410b-a6ea-c8e1d460551b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9cabd25c-3861-410b-a6ea-c8e1d460551b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 15:13:17 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Trying to clone 9cabd25c-3861-410b-a6ea-c8e1d460551b from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]). {{(pid=84270) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 15:13:18 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 15:13:18 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Image download 20.69 MB at 20.69 MB/s Apr 28 15:13:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0a4eaf-89e1-4010-9ab7-cdbc52f06b97]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:18 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD Apr 28 15:13:18 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:19 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:19 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e is fetched for user a81e06d6eb884e15a90db3c429152582. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 15:13:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a5960-b342-4f9b-9a68-6ef833aaae56]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:19 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD Apr 28 15:13:19 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:20 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD" returned: 0 in 1.229s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-120063041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cabd25c-3861-410b-a6ea-c8e1d460551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edbf8c645ee455781fffa33fc761e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:17Z,use_quota=True,user_id='a81e06d6eb884e15a90db3c429152582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Creating volume 9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:20 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:20 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1073741824 Apr 28 15:13:20 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-11889d3b-fcde-459b-9373-73cc3d473034-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "cinder-11889d3b-fcde-459b-9373-73cc3d473034-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-quobyte-11889d3b-fcde-459b-9373-73cc3d473034" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-11889d3b-fcde-459b-9373-73cc3d473034" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e0c56-b9ce-4dfb-ba39-80e7e0a87481]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:21 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 Apr 28 15:13:21 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:22 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1073741824" returned: 0 in 1.486s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:22 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=75,cinder:SELECT=50,cinder:DELETE=7,cinder:INSERT=13 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:13:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:22 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:22 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:22 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034" returned: 0 in 1.355s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:22 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034 Apr 28 15:13:22 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:23 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 0 in 1.037s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] <== create_volume: return (2602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.607s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=59,cinder:INSERT=22,cinder:UPDATE=72,cinder:DELETE=7 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Attempting download of e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 9cabd25c-3861-410b-a6ea-c8e1d460551b. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a919c2-5e3a-4004-ab84-1b4eef3c9170]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:23 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-11889d3b-fcde-459b-9373-73cc3d473034" returned: 0 in 1.104s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-11889d3b-fcde-459b-9373-73cc3d473034" released by "delete_volume" :: held 2.538s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:23 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5 Apr 28 15:13:23 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Created reservations ['10fac725-b6a9-400f-a9ba-1759643986cb', 'aaa4cd3a-4806-4bdf-b5d6-e2557419266f', 'd2888e93-115c-40bf-bf9d-8bd1fd6e1c1d', 'd703fe2d-8f9d-4f2c-bdc4-0698f9fce2d9'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:23 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:23 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "cinder-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-quobyte-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:24 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.853s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" acquired by "delete_volume" :: waited 0.095s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Deleted volume successfully. Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2a3eb-0c23-4016-9053-d668a4a9b820]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4a8ae465-b536-444a-8731-d93baa5031f3 tempest-VolumesTestJSON-341242922 None] Lock "cinder-11889d3b-fcde-459b-9373-73cc3d473034-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:24 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5" returned: 0 in 1.543s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:25 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 Apr 28 15:13:25 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:25 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5 Apr 28 15:13:25 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:26 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" returned: 0 in 1.142s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:26 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7 Apr 28 15:13:26 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:26 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5" returned: 1 in 1.212s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_arp433a5' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755e5a6-7198-4f6e-8898-94e05d391cd4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:26 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD Apr 28 15:13:26 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:26 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" returned: 0 in 0.898s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7" released by "delete_volume" :: held 2.113s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Created reservations ['98020ebc-9a37-44d0-a805-8a93d31707f8', '80fccedc-94d4-4ee7-a339-38060a9db554', '3bbaa363-e6c3-4cfd-9714-1bc64e78b1a4', 'f486037b-a0d8-4bf6-92ac-d7dabddf4337'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:27 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:27 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:27 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD" returned: 0 in 1.062s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e was qcow2, converting to raw {{(pid=84270) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 15:13:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:27 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:27 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-f946522c-01eb-4a0a-9ab6-59d764c605b5-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "cinder-f946522c-01eb-4a0a-9ab6-59d764c605b5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Acquiring lock "cinder-quobyte-f946522c-01eb-4a0a-9ab6-59d764c605b5" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-f946522c-01eb-4a0a-9ab6-59d764c605b5" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf233e26-d4ff-4e8a-acd7-ab1f50935cb2]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:28 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.349s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Deleted volume successfully. Apr 28 15:13:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-4c1b650c-fa6c-4d27-ab57-15950e372913 tempest-VolumesTestJSON-341242922 None] Lock "cinder-85616c2e-1fe5-4cc1-99f9-de83ab66a8c7-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:28 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 Apr 28 15:13:28 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:29 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5" returned: 0 in 1.387s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:29 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5 Apr 28 15:13:29 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:30 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 0 in 3.398s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:30 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_y_txu6gddevstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:13:30 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Converted 112.00 MB image at 32.93 MB/s Apr 28 15:13:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:30 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1G Apr 28 15:13:30 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:30 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f946522c-01eb-4a0a-9ab6-59d764c605b5" returned: 0 in 1.171s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "cinder-quobyte-f946522c-01eb-4a0a-9ab6-59d764c605b5" released by "delete_volume" :: held 2.637s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Created reservations ['35ffa0b1-5fef-4af4-ac44-810c3a32d6eb', 'f3d257ef-75af-4149-8420-895446b43a3b', '80d70612-d8cd-4c37-98b9-8e374d9d9471', 'b420171d-f7ae-4c5d-a564-bbb7426258c0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:31 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:31 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:32 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.977s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Deleted volume successfully. Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5485da3-9d4a-4c6d-ba10-27c1bd8952ff tempest-VolumesTestJSON-341242922 None] Lock "cinder-f946522c-01eb-4a0a-9ab6-59d764c605b5-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:32 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b 1G" returned: 0 in 1.959s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b304573-0301-442e-888e-6cb77f8b18d6]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:33 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:33 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:33 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 0 in 1.310s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:34 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:34 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:35 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 1 in 1.034s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Downloaded image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 9cabd25c-3861-410b-a6ea-c8e1d460551b successfully. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e for user a81e06d6eb884e15a90db3c429152582 is deleted. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Marking volume 9cabd25c-3861-410b-a6ea-c8e1d460551b as bootable. {{(pid=84270) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Copying metadata from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e to 9cabd25c-3861-410b-a6ea-c8e1d460551b. {{(pid=84270) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Creating volume glance metadata for volume 9cabd25c-3861-410b-a6ea-c8e1d460551b backed by image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84270) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a5df35-c92b-475f-9112-d54c2bc663cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cabd25c-3861-410b-a6ea-c8e1d460551b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c51a8c-b986-4bc6-b4ee-e8a42e65faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Volume volume-9cabd25c-3861-410b-a6ea-c8e1d460551b (9cabd25c-3861-410b-a6ea-c8e1d460551b): created successfully Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c51a8c-b986-4bc6-b4ee-e8a42e65faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Flow 'volume_create_manager' (de602a90-d7e0-455f-9162-8ec567022f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-114e8aa5-ed44-4c2c-b2fe-d1b3de29b48e tempest-VolumesImageMetadata-1583225340 None] Created volume successfully. Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Acquiring lock "cinder-9cabd25c-3861-410b-a6ea-c8e1d460551b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "cinder-9cabd25c-3861-410b-a6ea-c8e1d460551b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Acquiring lock "cinder-quobyte-9cabd25c-3861-410b-a6ea-c8e1d460551b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "cinder-quobyte-9cabd25c-3861-410b-a6ea-c8e1d460551b" acquired by "delete_volume" :: waited 0.064s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1745169-e4dc-401e-8d18-b9bf70ff3982]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:37 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:37 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:37 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 0 in 1.006s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-26ee7fd8-c8bc-445c-bd02-754d305a5a77 tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-1474790693: creating Apr 28 15:13:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-26ee7fd8-c8bc-445c-bd02-754d305a5a77 tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-1474790693: created successfully Apr 28 15:13:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-26ee7fd8-c8bc-445c-bd02-754d305a5a77 tempest-GroupSnapshotsTest-1328565825 None] Create group completed successfully. Apr 28 15:13:38 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:38 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:38 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 1 in 0.879s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:13:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:38 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b Apr 28 15:13:38 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:39 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9cabd25c-3861-410b-a6ea-c8e1d460551b" returned: 0 in 0.631s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "cinder-quobyte-9cabd25c-3861-410b-a6ea-c8e1d460551b" released by "delete_volume" :: held 2.615s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Created reservations ['3c4f4813-2cca-4cc2-a601-87f0a25f4650', 'baf53b1a-2873-4d65-bd65-c431b09409fa', '87b81a11-26d9-41e1-8624-0b23fead41f5', '3c3e90da-5a53-40ff-9d7f-ede56143aae3'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:39 devstack sudo[85536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:39 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:39 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (515e3338-da7b-4aea-ab45-525241771ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7682fbcb-65d4-46ee-99ec-4849265a1935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7682fbcb-65d4-46ee-99ec-4849265a1935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184187644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c23d6957-95af-4e21-8835-13243c3aa582,host='devstack@QuobyteHD#QuobyteHD',id=73378698-6ad6-4c32-9a88-3f10b95d2e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:40Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50cd05bc-5710-4369-b19e-542ea4b3f696),volume_type_id=50cd05bc-5710-4369-b19e-542ea4b3f696)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530b86af-1ef8-4981-baf0-8ff9774335c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530b86af-1ef8-4981-baf0-8ff9774335c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be17f03e-a74e-447d-b1de-bd60af935d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be17f03e-a74e-447d-b1de-bd60af935d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73378698-6ad6-4c32-9a88-3f10b95d2e9c', 'volume_name': 'volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e53fc4-5f87-47ef-8dca-e413c9b085dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e53fc4-5f87-47ef-8dca-e413c9b085dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bd0290-b753-4688-a4b6-648cd6822cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Volume 73378698-6ad6-4c32-9a88-3f10b95d2e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c', 'volume_size': 1} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c23d6957-95af-4e21-8835-13243c3aa582,created_at=2026-04-28T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184187644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c23d6957-95af-4e21-8835-13243c3aa582,host='devstack@QuobyteHD#QuobyteHD',id=73378698-6ad6-4c32-9a88-3f10b95d2e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:40Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50cd05bc-5710-4369-b19e-542ea4b3f696),volume_type_id=50cd05bc-5710-4369-b19e-542ea4b3f696)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Creating volume 73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:40 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:40 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c 1073741824 Apr 28 15:13:40 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:40 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.957s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Deleted volume successfully. Apr 28 15:13:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7295f14e-0156-4f60-83ff-c62dd10b0b91 tempest-VolumesImageMetadata-1583225340 None] Lock "cinder-9cabd25c-3861-410b-a6ea-c8e1d460551b-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:41 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c 1073741824" returned: 0 in 1.153s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:41 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:13:41 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:42 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.703s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bd0290-b753-4688-a4b6-648cd6822cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d5002c-646d-49a4-817f-b8493e8c1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:42 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Volume volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c (73378698-6ad6-4c32-9a88-3f10b95d2e9c): created successfully Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d5002c-646d-49a4-817f-b8493e8c1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (515e3338-da7b-4aea-ab45-525241771ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4091f918-8da9-47dd-baa2-f97ad7661ec7 tempest-GroupSnapshotsTest-1328565825 None] Created volume successfully. Apr 28 15:13:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] GroupSnapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: creating. Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Group snapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: creating. {{(pid=84270) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Creating offline snapshot c2d3840b-4b45-4eb6-b873-45b28e6d7e30 of volume 73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f90cb-1fe8-4a03-b0b8-aaca61e9b4b9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:42 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:13:42 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:43 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.796s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:43 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 1G Apr 28 15:13:43 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:44 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 1G" returned: 0 in 1.133s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:44 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:13:44 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:45 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.890s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:45 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:13:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:45 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:13:45 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Flow 'volume_create_manager' (493f6342-3b1a-4bdb-b9fc-3374a7bc9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ecec1b-b2e8-422e-8b25-8dd93eed3a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ecec1b-b2e8-422e-8b25-8dd93eed3a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:46Z,deleted=False,deleted_at=None,display_description='',display_name='dce17c08-f12e-4480-a954-a50d2cf67332-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b2b73a-373d-4d82-8895-862b967a1d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab905c6f4d2d4ff183302447de36e4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:46Z,use_quota=True,user_id='6d4fdf1f787c405ea484f538a81ebcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae1c636-9eaf-4906-bebc-6b6b348a5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae1c636-9eaf-4906-bebc-6b6b348a5fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96bef52-de68-4b26-a4b3-5ef00c92fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96bef52-de68-4b26-a4b3-5ef00c92fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b2b73a-373d-4d82-8895-862b967a1d9e', 'volume_name': 'volume-56b2b73a-373d-4d82-8895-862b967a1d9e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae6805-1a9c-4850-9295-56da8fa1b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae6805-1a9c-4850-9295-56da8fa1b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32331bdd-aacc-4940-be9d-5d4c8f88a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:46 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume 56b2b73a-373d-4d82-8895-862b967a1d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b2b73a-373d-4d82-8895-862b967a1d9e', 'volume_size': 1} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:46 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.857s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:46 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info Apr 28 15:13:46 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:47 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info" returned: 0 in 0.951s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:47 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:47 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info Apr 28 15:13:47 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Flow 'volume_create_manager' (86002532-ca84-45d5-b4c9-880628f30651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1096be1d-be02-4ed4-98f1-54a6b280bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1096be1d-be02-4ed4-98f1-54a6b280bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-267029670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e4dee6-eecd-4148-9411-053cf021edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba391ca42d14d249860635f69e4aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:48Z,use_quota=True,user_id='6d7bfc45baeb47e39d262c90e88f26f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa52dd8-003a-4e0c-872c-12bdcd8c0a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa52dd8-003a-4e0c-872c-12bdcd8c0a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc31270-e004-46ca-bab2-bdff73680af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc31270-e004-46ca-bab2-bdff73680af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e4dee6-eecd-4148-9411-053cf021edb4', 'volume_name': 'volume-64e4dee6-eecd-4148-9411-053cf021edb4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b14c40f-5e42-4545-91b9-fb7a9914aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b14c40f-5e42-4545-91b9-fb7a9914aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae96aa-3961-46ba-a13f-f5d4ef9c0a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:47 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Volume 64e4dee6-eecd-4148-9411-053cf021edb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e4dee6-eecd-4148-9411-053cf021edb4', 'volume_size': 1} Apr 28 15:13:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:48 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.info" returned: 0 in 0.787s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.528s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.016s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:46Z,deleted=False,deleted_at=None,display_description='',display_name='dce17c08-f12e-4480-a954-a50d2cf67332-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b2b73a-373d-4d82-8895-862b967a1d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab905c6f4d2d4ff183302447de36e4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:46Z,use_quota=True,user_id='6d4fdf1f787c405ea484f538a81ebcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Creating volume 56b2b73a-373d-4d82-8895-862b967a1d9e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:48 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:48 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e 1073741824 Apr 28 15:13:48 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-faf6d3c6-91e4-48c1-9d7c-b8f7d46569b2 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: created successfully Apr 28 15:13:49 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e 1073741824" returned: 0 in 0.919s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:49 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e Apr 28 15:13:49 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:49 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e" returned: 0 in 0.651s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-267029670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e4dee6-eecd-4148-9411-053cf021edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba391ca42d14d249860635f69e4aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:13:48Z,use_quota=True,user_id='6d7bfc45baeb47e39d262c90e88f26f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Creating volume 64e4dee6-eecd-4148-9411-053cf021edb4 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:49 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:49 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 1073741824 Apr 28 15:13:49 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32331bdd-aacc-4940-be9d-5d4c8f88a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b2b73a-373d-4d82-8895-862b967a1d9e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f80234c-f6c9-4eed-845d-01e3b00795e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:49 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume volume-56b2b73a-373d-4d82-8895-862b967a1d9e (56b2b73a-373d-4d82-8895-862b967a1d9e): created successfully Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f80234c-f6c9-4eed-845d-01e3b00795e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Flow 'volume_create_manager' (493f6342-3b1a-4bdb-b9fc-3374a7bc9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:49 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-4a5a181a-eed4-4141-bfb0-88178a7baf01 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Created volume successfully. Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:50 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:50 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:50 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 1073741824" returned: 0 in 0.860s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:50 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 Apr 28 15:13:50 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:51 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.717s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:51 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4" returned: 0 in 0.690s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.192s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30-51feafd6-2fe6-450a-acbc-1970df0b75f1" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae96aa-3961-46ba-a13f-f5d4ef9c0a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e4dee6-eecd-4148-9411-053cf021edb4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d64757-afd2-454b-b331-e4eaf441294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30-51feafd6-2fe6-450a-acbc-1970df0b75f1" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Creating volume 51feafd6-2fe6-450a-acbc-1970df0b75f1 from snapshot c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:51 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Volume volume-64e4dee6-eecd-4148-9411-053cf021edb4 (64e4dee6-eecd-4148-9411-053cf021edb4): created successfully Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d64757-afd2-454b-b331-e4eaf441294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Flow 'volume_create_manager' (86002532-ca84-45d5-b4c9-880628f30651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:13:51 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d06d9ce6-abd5-4fb4-91fb-bf7bc7ebecca tempest-VolumesMetadataTest-774057025 None] Created volume successfully. Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] snapshot: c2d3840b-4b45-4eb6-b873-45b28e6d7e30, volume: 51feafd6-2fe6-450a-acbc-1970df0b75f1, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70954eb-369e-4a4b-ae65-7d4be3faa392]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:51 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:13:51 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:52 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.758s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0e481-404a-460a-b293-e8bc9819f4ee]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:52 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:13:52 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Acquiring lock "cinder-64e4dee6-eecd-4148-9411-053cf021edb4-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "cinder-64e4dee6-eecd-4148-9411-053cf021edb4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Acquiring lock "cinder-quobyte-64e4dee6-eecd-4148-9411-053cf021edb4" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "cinder-quobyte-64e4dee6-eecd-4148-9411-053cf021edb4" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de89a3a-9274-4375-9353-281a71f69b27]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:13:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:53 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 Apr 28 15:13:53 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:53 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.910s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:53 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:13:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:53 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 Apr 28 15:13:53 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:54 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4" returned: 0 in 1.207s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:54 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4 Apr 28 15:13:54 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:55 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:55 devstack cinder-volume[84270]: WARNING py.warnings [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 28 15:13:55 devstack cinder-volume[84270]: .first() Apr 28 15:13:55 devstack cinder-volume[84270]: Apr 28 15:13:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-64e4dee6-eecd-4148-9411-053cf021edb4" returned: 0 in 1.689s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "cinder-quobyte-64e4dee6-eecd-4148-9411-053cf021edb4" released by "delete_volume" :: held 3.058s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Created reservations ['d8df7278-4d6d-4327-a1f4-88568699b6dc', 'fcbaa455-ac32-4e09-9320-c3fbdaf54296', '776846b2-9441-43bb-9e04-feeeb6721461', '7e563974-9dbb-4ff8-9c4d-3bbfa721f650'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:13:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:13:56 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:13:56 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:13:59 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 28 15:13:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 2.511s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:13:59 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:13:59 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Deleted volume successfully. Apr 28 15:13:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1903d1e5-c9eb-49f2-9def-2de7ead3a524 tempest-VolumesMetadataTest-774057025 None] Lock "cinder-64e4dee6-eecd-4148-9411-053cf021edb4-delete_volume" released by "delete_volume" :: held 6.366s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Flow 'volume_create_manager' (27681adf-2885-4331-b9bb-5250e7df89cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a7dd56-0ead-417c-9d8f-4eebd067d9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a7dd56-0ead-417c-9d8f-4eebd067d9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-528237499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9358dae1-6689-4e55-ba81-8321092ce4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366a0989ac5b44ba8b62c01a2299fabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:02Z,use_quota=True,user_id='2e84599d7fc74e5ebf653bd04b8a7ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f386210-0bf9-4a28-8aae-e8479cdc5403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f386210-0bf9-4a28-8aae-e8479cdc5403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f62c0-9152-40cd-9cac-dbdf732a5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f62c0-9152-40cd-9cac-dbdf732a5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9358dae1-6689-4e55-ba81-8321092ce4ba', 'volume_name': 'volume-9358dae1-6689-4e55-ba81-8321092ce4ba', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4037f2-d49d-49ab-b928-d1f16013cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4037f2-d49d-49ab-b928-d1f16013cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ee311-baa0-4c44-b4c9-501cc7be5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Volume 9358dae1-6689-4e55-ba81-8321092ce4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9358dae1-6689-4e55-ba81-8321092ce4ba', 'volume_size': 1} Apr 28 15:14:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:02 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1" returned: 0 in 9.510s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:02 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7679d-d8c1-481b-88d8-df8f7ed0fb88]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:02 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:14:02 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:03 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 1.008s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:03 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c, size 1024.00 MB, duration 9.51 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:14:03 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Converted 1024.00 MB image at 107.64 MB/s Apr 28 15:14:03 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:14:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:03 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 Apr 28 15:14:03 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:04 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" released by "_copy_volume_from_snapshot" :: held 13.028s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30-51feafd6-2fe6-450a-acbc-1970df0b75f1" released by "_create_volume_from_snapshot" :: held 13.095s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.138s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.573s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c539a-fe28-4431-8ec5-24ede33f7ddd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5d50d895-0089-4107-b863-6cbf7a40949f tempest-GroupSnapshotsTest-1328565825 None] Create group from source-snapshot-43875a18-ac13-4d76-ade9-e15b3b52a7b5 completed successfully. Apr 28 15:14:04 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e Apr 28 15:14:04 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:05 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e" returned: 0 in 1.027s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.085s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-528237499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9358dae1-6689-4e55-ba81-8321092ce4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366a0989ac5b44ba8b62c01a2299fabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:02Z,use_quota=True,user_id='2e84599d7fc74e5ebf653bd04b8a7ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Creating volume 9358dae1-6689-4e55-ba81-8321092ce4ba {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:05 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:05 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba 1073741824 Apr 28 15:14:05 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353', 'name': 'volume-56b2b73a-373d-4d82-8895-862b967a1d9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce067aeb-422d-4bd1-aeef-92a62a192690', 'enforce_multipath': True} {{(pid=84270) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 15:14:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-1a845d66-7097-47cd-96f9-60a342069f03 req-8aa35752-8f3a-4f5c-96bb-6e2342b38a2a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] attachment_update completed successfully. Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Flow 'volume_create_manager' (7df6727d-e8ee-4e89-8e3b-b915d3179a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13bacf3-2d0a-4c39-9d23-f3cc120d7c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13bacf3-2d0a-4c39-9d23-f3cc120d7c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-308351348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dda454f-0015-48a5-922f-2ae942e50ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c98d78d6c648008ba034cda14bdb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:06Z,use_quota=True,user_id='c1e51146551248789fe1d926914b7aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a0b5a4-2bd5-4f0a-9ff7-2c2532acee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a0b5a4-2bd5-4f0a-9ff7-2c2532acee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d8c6ef-5b27-4358-9487-588a799c4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d8c6ef-5b27-4358-9487-588a799c4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dda454f-0015-48a5-922f-2ae942e50ccb', 'volume_name': 'volume-3dda454f-0015-48a5-922f-2ae942e50ccb', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29671b4b-d5e8-4013-95b5-7ca20f7e4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29671b4b-d5e8-4013-95b5-7ca20f7e4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd935390-8b07-4471-b034-0f993d690869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:06 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Volume 3dda454f-0015-48a5-922f-2ae942e50ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dda454f-0015-48a5-922f-2ae942e50ccb', 'volume_size': 1} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3ee05e-272d-4ce0-8436-8d936d55419e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:06 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 Apr 28 15:14:06 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:06 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba 1073741824" returned: 0 in 1.154s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:06 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba Apr 28 15:14:06 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:07 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1" returned: 0 in 0.822s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:07 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1 Apr 28 15:14:07 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:07 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba" returned: 0 in 0.805s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-308351348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dda454f-0015-48a5-922f-2ae942e50ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c98d78d6c648008ba034cda14bdb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:06Z,use_quota=True,user_id='c1e51146551248789fe1d926914b7aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Creating volume 3dda454f-0015-48a5-922f-2ae942e50ccb {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:07 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ee311-baa0-4c44-b4c9-501cc7be5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9358dae1-6689-4e55-ba81-8321092ce4ba', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b805a565-b1a5-4076-a0a5-278433586ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:07 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Volume volume-9358dae1-6689-4e55-ba81-8321092ce4ba (9358dae1-6689-4e55-ba81-8321092ce4ba): created successfully Apr 28 15:14:07 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb 1073741824 Apr 28 15:14:07 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b805a565-b1a5-4076-a0a5-278433586ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Flow 'volume_create_manager' (27681adf-2885-4331-b9bb-5250e7df89cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-49fff600-91fc-4c46-a9d9-e3ae5b534014 tempest-DeleteServersTestJSON-1558335672 None] Created volume successfully. Apr 28 15:14:07 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-51feafd6-2fe6-450a-acbc-1970df0b75f1" returned: 0 in 0.670s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-51feafd6-2fe6-450a-acbc-1970df0b75f1" released by "delete_volume" :: held 1.561s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['bc947e7b-fa9f-47c6-98c4-a94d0e868b55'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:08 devstack cinder-volume[84270]: WARNING cinder.quota [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-645977990 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-645977990, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:08 devstack cinder-volume[84270]: WARNING cinder.quota [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-645977990 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-645977990, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['a60fc108-f713-4499-8062-e1b8b52dada6', '6f9fae0a-f449-455f-88c3-5d395ffa6b2f', 'c5437c3b-5d58-4a34-b6be-16f8f76827c4', '61c95a4c-d171-4cdb-8d9e-e8eff07a1782'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:08 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:08 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: deleting Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: deleting {{(pid=84270) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Deleting offline snapshot c2d3840b-4b45-4eb6-b873-45b28e6d7e30 of volume 73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] snapshot_file for this snap is: volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:14:08 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb 1073741824" returned: 0 in 1.245s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f54658-b85d-4b73-b5ca-95835a709bbd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:09 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb Apr 28 15:14:09 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:09 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:14:09 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:09 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.907s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:09 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6c69f424-b35c-4dbe-9bc0-93df95725a7c tempest-GroupSnapshotsTest-1328565825 None] Delete group completed successfully. Apr 28 15:14:09 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb" returned: 0 in 0.861s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd935390-8b07-4471-b034-0f993d690869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dda454f-0015-48a5-922f-2ae942e50ccb', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da4334e-9c63-4e4c-8492-7c3e004b4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:09 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:09 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Volume volume-3dda454f-0015-48a5-922f-2ae942e50ccb (3dda454f-0015-48a5-922f-2ae942e50ccb): created successfully Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da4334e-9c63-4e4c-8492-7c3e004b4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Flow 'volume_create_manager' (7df6727d-e8ee-4e89-8e3b-b915d3179a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.990s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:14:09 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cd563d16-3637-4a50-af30-3d00860d3d95 tempest-VolumesTransfersTest-189788108 None] Created volume successfully. Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfeda9-f651-46d8-8480-1c2391dfe7c6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:10 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:14:10 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:10 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.707s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:10 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:14:10 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:11 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f5231810-7608-46f6-8658-5a15fa65e8f8 tempest-VolumesTransfersTest-784228465 None] Transfer volume completed successfully. Apr 28 15:14:11 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.960s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:11 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30 Apr 28 15:14:11 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b52805-aa0d-4f19-aec7-b1af23ba5374]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Acquiring lock "cinder-3dda454f-0015-48a5-922f-2ae942e50ccb-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:12 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba Apr 28 15:14:12 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "cinder-3dda454f-0015-48a5-922f-2ae942e50ccb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Acquiring lock "cinder-quobyte-3dda454f-0015-48a5-922f-2ae942e50ccb" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "cinder-quobyte-3dda454f-0015-48a5-922f-2ae942e50ccb" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:12 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c.c2d3840b-4b45-4eb6-b873-45b28e6d7e30" returned: 0 in 0.918s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b865dd-3fa3-43e7-872e-5bd827b94415]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-c2d3840b-4b45-4eb6-b873-45b28e6d7e30" released by "_delete_snapshot" :: held 3.708s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" released by "delete_snapshot" :: held 3.766s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:12 devstack cinder-volume[84270]: WARNING cinder.quota [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-645977990 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-645977990, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:12 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb Apr 28 15:14:12 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:12 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['0c35544a-09f0-43a1-a7e4-3d462be17f39', '40cd96ae-bc7a-45c0-82b4-e7e77511493e', 'cbcbef65-d817-438f-b484-da7d475dd22e', '89f6ded9-bf74-4fac-8114-704e02a836a6'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-90f2096c-03e0-466e-b1b6-7cd368e6b38a tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 43875a18-ac13-4d76-ade9-e15b3b52a7b5: deleted successfully Apr 28 15:14:13 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba" returned: 0 in 1.014s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353', 'name': 'volume-9358dae1-6689-4e55-ba81-8321092ce4ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f0e44a9-c6c6-4c81-807b-c67eb31658aa', 'enforce_multipath': True} {{(pid=84270) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 15:14:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-7b5c6096-0757-4c90-b1d3-b51167376a8e req-f5ba5375-fea2-4688-a213-c1e4a4f670ab tempest-DeleteServersTestJSON-1558335672 None] attachment_update completed successfully. Apr 28 15:14:13 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb" returned: 0 in 0.854s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:13 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb Apr 28 15:14:13 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b227306-e702-40cf-a0fc-e17d99526730]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:13 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:14:13 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:14 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3dda454f-0015-48a5-922f-2ae942e50ccb" returned: 0 in 0.724s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "cinder-quobyte-3dda454f-0015-48a5-922f-2ae942e50ccb" released by "delete_volume" :: held 1.657s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Created reservations ['033611e1-fdad-493b-ad0b-69e01d88fe9e', 'ddad20cf-1b67-4373-955f-4f6498dbdbd9', '4f86c816-c5a5-46eb-93cd-f5c38ec925ee', '5be97a12-423c-476e-bf03-3019c9f1e642'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:14 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:14 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:14 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.820s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:14 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c Apr 28 15:14:14 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:15 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:15 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Deleted volume successfully. Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9399c02d-4dc6-429c-bc51-5576a946066f tempest-VolumesTransfersTest-785227088 None] Lock "cinder-3dda454f-0015-48a5-922f-2ae942e50ccb-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:15 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-73378698-6ad6-4c32-9a88-3f10b95d2e9c" returned: 0 in 0.771s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Flow 'volume_create_manager' (f2d37b70-88c1-412f-8855-530fb5b5abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ac032-ab63-4324-bfc0-da25af433852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-73378698-6ad6-4c32-9a88-3f10b95d2e9c" released by "delete_volume" :: held 1.697s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ac032-ab63-4324-bfc0-da25af433852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-163758737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c98d78d6c648008ba034cda14bdb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:15Z,use_quota=True,user_id='c1e51146551248789fe1d926914b7aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308846f4-12c4-420f-9beb-3e2e54b4da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308846f4-12c4-420f-9beb-3e2e54b4da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbab4ae8-9d31-447e-9d3c-a88179147dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbab4ae8-9d31-447e-9d3c-a88179147dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb', 'volume_name': 'volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15361533-6727-42db-a039-136c28098e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15361533-6727-42db-a039-136c28098e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf91182-b3bd-4192-9f6c-70a8f05a8e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:15 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Volume 7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb', 'volume_size': 1} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-163758737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c98d78d6c648008ba034cda14bdb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:15Z,use_quota=True,user_id='c1e51146551248789fe1d926914b7aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Creating volume 7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:15 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:15 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb 1073741824 Apr 28 15:14:15 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['1f61e34b-a07a-433b-934e-967f90792109'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:15 devstack cinder-volume[84270]: WARNING cinder.db.sqlalchemy.api [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-645977990'] Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['0060299e-e61e-437b-8d34-bcf242e1af06', 'f30ce845-91aa-48ec-98b5-25ece2d29e16', 'b878532f-95f7-4ae4-bd8b-14647c501ca3', 'f4bc3bc5-3b9b-4130-ac18-d5083234e8b1'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:15 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:15 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8b73edbc-f1d6-431f-9e60-54ae27ad970f tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-1119054186: creating Apr 28 15:14:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8b73edbc-f1d6-431f-9e60-54ae27ad970f tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-1119054186: created successfully Apr 28 15:14:16 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8b73edbc-f1d6-431f-9e60-54ae27ad970f tempest-GroupSnapshotsTest-1328565825 None] Create group completed successfully. Apr 28 15:14:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb 1073741824" returned: 0 in 1.290s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:16 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.956s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:16 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f89cbfd7-d276-468a-87f6-74d2bbf1eae3 tempest-GroupSnapshotsTest-1328565825 None] Delete group completed successfully. Apr 28 15:14:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:16 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb Apr 28 15:14:16 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:17 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" returned: 0 in 0.681s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf91182-b3bd-4192-9f6c-70a8f05a8e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ee311-54ad-4ac8-b661-f97f57192841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Volume volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb (7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb): created successfully Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ee311-54ad-4ac8-b661-f97f57192841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Flow 'volume_create_manager' (f2d37b70-88c1-412f-8855-530fb5b5abb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-efe33027-959e-4afd-9e57-8398049a99b0 tempest-VolumesTransfersTest-189788108 None] Created volume successfully. Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (0e468f31-adb2-4289-8693-d83eaaa54d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb23081f-8a53-4a43-bbd0-964268d336b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb23081f-8a53-4a43-bbd0-964268d336b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-244396138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b2117b-4bff-462b-96ac-04045773bbac,host='devstack@QuobyteHD#QuobyteHD',id=6f58f532-9ded-47d4-8621-b5a4564b33dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:18Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5732c2ba-c9cf-44ed-be75-7dae502ad7e2),volume_type_id=5732c2ba-c9cf-44ed-be75-7dae502ad7e2)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77cee9c-2d03-42e9-b7fe-05a6ab94da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77cee9c-2d03-42e9-b7fe-05a6ab94da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cbdad4-7c2d-4bae-a138-803e88b5a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cbdad4-7c2d-4bae-a138-803e88b5a00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f58f532-9ded-47d4-8621-b5a4564b33dd', 'volume_name': 'volume-6f58f532-9ded-47d4-8621-b5a4564b33dd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b6705d-5703-46ec-acd9-b56e7eebc0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b6705d-5703-46ec-acd9-b56e7eebc0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83883787-5677-4e39-84ec-3f90af463b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:18 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Volume 6f58f532-9ded-47d4-8621-b5a4564b33dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f58f532-9ded-47d4-8621-b5a4564b33dd', 'volume_size': 1} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06b2117b-4bff-462b-96ac-04045773bbac,created_at=2026-04-28T13:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-244396138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b2117b-4bff-462b-96ac-04045773bbac,host='devstack@QuobyteHD#QuobyteHD',id=6f58f532-9ded-47d4-8621-b5a4564b33dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:18Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5732c2ba-c9cf-44ed-be75-7dae502ad7e2),volume_type_id=5732c2ba-c9cf-44ed-be75-7dae502ad7e2)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Creating volume 6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:18 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:18 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd 1073741824 Apr 28 15:14:18 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Acquiring lock "cinder-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "cinder-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Acquiring lock "cinder-quobyte-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "cinder-quobyte-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" acquired by "delete_volume" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4272011-dbf7-4994-afd4-0956e7579b36]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:19 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb Apr 28 15:14:19 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:19 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd 1073741824" returned: 0 in 1.111s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:19 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd Apr 28 15:14:19 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:19 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" returned: 0 in 0.804s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:20 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb Apr 28 15:14:20 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:20 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd" returned: 0 in 0.622s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83883787-5677-4e39-84ec-3f90af463b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f58f532-9ded-47d4-8621-b5a4564b33dd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a4ee21-db42-4816-8348-3848fbe5a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:20 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Volume volume-6f58f532-9ded-47d4-8621-b5a4564b33dd (6f58f532-9ded-47d4-8621-b5a4564b33dd): created successfully Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a4ee21-db42-4816-8348-3848fbe5a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (0e468f31-adb2-4289-8693-d83eaaa54d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5120fd0d-760d-4d65-bdbf-a316c9090a0f tempest-GroupSnapshotsTest-1328565825 None] Created volume successfully. Apr 28 15:14:20 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" returned: 0 in 0.835s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "cinder-quobyte-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb" released by "delete_volume" :: held 1.747s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Created reservations ['a9e69783-f8e3-4f1a-bef4-9e3c89b0cbe6', '8d4f2f80-d2ca-4169-8cd4-c65d993eb1b0', 'e1339b32-acbb-47b6-9632-b35b77e69baf', '7c8c30f9-d7ab-4089-95f3-4d4a600945b1'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:21 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:21 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (87286900-9148-4ca7-8e2a-8825b94ba4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ee6b9f-edcb-49d2-b1bc-13a905cda325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ee6b9f-edcb-49d2-b1bc-13a905cda325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-240999047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b2117b-4bff-462b-96ac-04045773bbac,host='devstack@QuobyteHD#QuobyteHD',id=0b3229d4-4e4c-4d6b-b5d3-03669ac09233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:21Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5732c2ba-c9cf-44ed-be75-7dae502ad7e2),volume_type_id=5732c2ba-c9cf-44ed-be75-7dae502ad7e2)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d4516e-cf18-4ece-bf1b-79a26a55facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d4516e-cf18-4ece-bf1b-79a26a55facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786917a-952b-4ff3-b671-a5757c8bf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786917a-952b-4ff3-b671-a5757c8bf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3229d4-4e4c-4d6b-b5d3-03669ac09233', 'volume_name': 'volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f336f4-6a3a-4d55-b853-9beec9e55f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f336f4-6a3a-4d55-b853-9beec9e55f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e23188f-f46a-4cfa-8c85-bff5c0eb30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Volume 0b3229d4-4e4c-4d6b-b5d3-03669ac09233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233', 'volume_size': 1} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06b2117b-4bff-462b-96ac-04045773bbac,created_at=2026-04-28T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-240999047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b2117b-4bff-462b-96ac-04045773bbac,host='devstack@QuobyteHD#QuobyteHD',id=0b3229d4-4e4c-4d6b-b5d3-03669ac09233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:21Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5732c2ba-c9cf-44ed-be75-7dae502ad7e2),volume_type_id=5732c2ba-c9cf-44ed-be75-7dae502ad7e2)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Creating volume 0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:21 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:21 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 1073741824 Apr 28 15:14:21 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-3de9ea58-2c5b-405a-b4ea-1cc75c647a18 req-da9725b7-d929-4947-aada-e0ed370f932b tempest-DeleteServersTestJSON-1558335672 None] Terminate volume connection completed successfully. Apr 28 15:14:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-3de9ea58-2c5b-405a-b4ea-1cc75c647a18 req-da9725b7-d929-4947-aada-e0ed370f932b tempest-DeleteServersTestJSON-1558335672 None] Deleting attachment 1f0e44a9-c6c6-4c81-807b-c67eb31658aa. {{(pid=84270) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 15:14:22 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.882s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Deleted volume successfully. Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cebf5fd9-0e53-493f-abc4-eafd0fc9f8a4 tempest-VolumesTransfersTest-785227088 None] Lock "cinder-7c7ccc8c-bfdc-4ad0-87cd-45f209b77cdb-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:22 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 1073741824" returned: 0 in 1.170s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=109,cinder:SELECT=114,cinder:INSERT=32,cinder:DELETE=6 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:14:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:22 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 Apr 28 15:14:22 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:23 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" returned: 0 in 0.838s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=103,cinder:INSERT=31,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e23188f-f46a-4cfa-8c85-bff5c0eb30e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1383144f-afd2-4e2f-800e-8bb87dfae007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:23 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Volume volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 (0b3229d4-4e4c-4d6b-b5d3-03669ac09233): created successfully Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1383144f-afd2-4e2f-800e-8bb87dfae007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (87286900-9148-4ca7-8e2a-8825b94ba4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:23 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8d0cb0fd-fc0e-4614-82b1-15bf034896f2 tempest-GroupSnapshotsTest-1328565825 None] Created volume successfully. Apr 28 15:14:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ab9345ac-7270-4405-8ce3-1ba76a3f3f09 tempest-GroupSnapshotsTest-1328565825 None] Update group completed successfully. Apr 28 15:14:25 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-702afe57-b74b-49a0-a70f-9ee3223ab3c7 tempest-GroupSnapshotsTest-1328565825 None] Update group completed successfully. Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "cinder-9358dae1-6689-4e55-ba81-8321092ce4ba-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "cinder-9358dae1-6689-4e55-ba81-8321092ce4ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "cinder-quobyte-9358dae1-6689-4e55-ba81-8321092ce4ba" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "cinder-quobyte-9358dae1-6689-4e55-ba81-8321092ce4ba" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a834e79-d022-4b2d-924c-010b2a3b767f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:27 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba Apr 28 15:14:27 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:27 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0a5aadbf-2539-429f-9235-6031d095a233 tempest-GroupSnapshotsTest-1328565825 None] Update group completed successfully. Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Flow 'volume_create_manager' (684319d5-f592-473d-bd63-afba336c733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafac16-8d82-4e15-80f0-ebbcd5714b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafac16-8d82-4e15-80f0-ebbcd5714b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2146475551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ceb0ac-866d-4732-8424-9b08cd49afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0d219b8ad4c84b5c0dec490092afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:28Z,use_quota=True,user_id='768311767d7445f7a41b901a2415b15e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160e0de5-1833-47c1-afbd-4271cde2ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160e0de5-1833-47c1-afbd-4271cde2ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9ae979-e728-4e23-8bc6-0104bf0e34a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9ae979-e728-4e23-8bc6-0104bf0e34a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ceb0ac-866d-4732-8424-9b08cd49afa6', 'volume_name': 'volume-62ceb0ac-866d-4732-8424-9b08cd49afa6', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc04296a-762e-4b53-963e-8a8cddd36f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc04296a-762e-4b53-963e-8a8cddd36f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac37d359-f8a6-4eb9-93e9-dd61482a753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Volume 62ceb0ac-866d-4732-8424-9b08cd49afa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ceb0ac-866d-4732-8424-9b08cd49afa6', 'volume_size': 1} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2146475551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ceb0ac-866d-4732-8424-9b08cd49afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0d219b8ad4c84b5c0dec490092afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:28Z,use_quota=True,user_id='768311767d7445f7a41b901a2415b15e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Creating volume 62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:14:27 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:27 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba" returned: 0 in 0.807s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:27 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 1073741824 Apr 28 15:14:27 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:27 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba Apr 28 15:14:27 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d6aa9f77-3ae6-45f3-8f3a-854d67bd61e4 tempest-GroupSnapshotsTest-1328565825 None] Update group completed successfully. Apr 28 15:14:28 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9358dae1-6689-4e55-ba81-8321092ce4ba" returned: 0 in 0.944s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "cinder-quobyte-9358dae1-6689-4e55-ba81-8321092ce4ba" released by "delete_volume" :: held 1.798s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Created reservations ['49b03617-bfe7-489a-bd15-4d6450636b72', 'ef647cad-14a4-4c94-8caf-637a289d1443', '4e5980f2-3cd6-49b2-a35c-5fae3882da1c', 'fb4bb95d-0ef2-44bb-94ce-f4b16cad57b5'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:28 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 1073741824" returned: 0 in 1.154s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:28 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:28 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:28 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:14:28 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:29 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.746s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Deleted volume successfully. Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-19cb0554-8a64-4630-ada3-532bf110fd88 tempest-DeleteServersTestJSON-1558335672 None] Lock "cinder-9358dae1-6689-4e55-ba81-8321092ce4ba-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:29 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 0.974s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac37d359-f8a6-4eb9-93e9-dd61482a753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ceb0ac-866d-4732-8424-9b08cd49afa6', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238180be-99b3-499e-9213-3ee5fdd64689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:29 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Volume volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 (62ceb0ac-866d-4732-8424-9b08cd49afa6): created successfully Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238180be-99b3-499e-9213-3ee5fdd64689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Flow 'volume_create_manager' (684319d5-f592-473d-bd63-afba336c733e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8021675a-e5ac-4400-bd1d-7474b44b2977 tempest-VolumesCloneTest-795630154 None] Created volume successfully. Apr 28 15:14:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] GroupSnapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: creating. Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Group snapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: creating. {{(pid=84270) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Creating offline snapshot 26f11443-81e5-4625-ba24-4e033b498d87 of volume 0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e3c4ef-1c2d-41c2-ac91-ae5e2ea5e530]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:30 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 Apr 28 15:14:30 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:31 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" returned: 0 in 0.887s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:31 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 1G Apr 28 15:14:31 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Flow 'volume_create_manager' (205f2537-bbed-456c-a8e5-87402ee77732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7b2d2f-2e51-4eca-8536-736e3a3ec543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7b2d2f-2e51-4eca-8536-736e3a3ec543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1775329216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db679a93-ffcc-48bb-881f-e5e083843d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0d219b8ad4c84b5c0dec490092afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:14:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=62ceb0ac-866d-4732-8424-9b08cd49afa6,status='creating',terminated_at=None,updated_at=2026-04-28T13:14:32Z,use_quota=True,user_id='768311767d7445f7a41b901a2415b15e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40554d-920e-412c-87bb-18fd11831865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40554d-920e-412c-87bb-18fd11831865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97ee672-d9c4-48ae-b6c4-a38cd3e69be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97ee672-d9c4-48ae-b6c4-a38cd3e69be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'db679a93-ffcc-48bb-881f-e5e083843d87', 'volume_name': 'volume-db679a93-ffcc-48bb-881f-e5e083843d87', 'volume_size': 2, 'source_volid': '62ceb0ac-866d-4732-8424-9b08cd49afa6', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d686841-bf59-4ba3-b46d-a87288ef79b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d686841-bf59-4ba3-b46d-a87288ef79b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d3639-5f84-4fd6-ad9f-bd1bd06d28ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:14:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Volume db679a93-ffcc-48bb-881f-e5e083843d87: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-db679a93-ffcc-48bb-881f-e5e083843d87', 'volume_size': 2, 'source_volid': '62ceb0ac-866d-4732-8424-9b08cd49afa6', 'source_volstatus': 'available'} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:32 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 1G" returned: 0 in 1.469s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:32 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 Apr 28 15:14:32 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:33 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87" returned: 0 in 1.032s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:33 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:14:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:33 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 Apr 28 15:14:33 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:34 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87" returned: 0 in 0.836s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:34 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info Apr 28 15:14:34 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:35 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info" returned: 0 in 0.966s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:35 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:14:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:35 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info Apr 28 15:14:35 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:36 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.info" returned: 0 in 0.778s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.092s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Creating offline snapshot 76536074-b439-4083-9d3f-86f0f160be2f of volume 6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ec2b5-c46f-4e92-b109-3507a59e9136]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:36 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd Apr 28 15:14:36 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:37 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd" returned: 0 in 1.048s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:37 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f 1G Apr 28 15:14:37 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:38 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f 1G" returned: 0 in 0.910s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58f532-9ded-47d4-8621-b5a4564b33dd -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:38 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58f532-9ded-47d4-8621-b5a4564b33dd -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f Apr 28 15:14:38 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:39 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58f532-9ded-47d4-8621-b5a4564b33dd -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f" returned: 0 in 0.762s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:39 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:14:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:39 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f Apr 28 15:14:39 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:39 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f" returned: 0 in 0.789s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:40 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info Apr 28 15:14:40 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:40 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info" returned: 0 in 0.670s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:40 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:14:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:40 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info Apr 28 15:14:40 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:41 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.info" returned: 0 in 0.648s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.983s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.226s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:41 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Cloning volume 62ceb0ac-866d-4732-8424-9b08cd49afa6 to volume db679a93-ffcc-48bb-881f-e5e083843d87 Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Creating offline snapshot ff981b84-d921-46a9-b696-35b844a0408e of volume 62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac2a40-447a-4252-afe2-c90375892631]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-236d360d-e5b5-4fa6-81cf-832a2fc7c4aa tempest-GroupSnapshotsTest-1328565825 None] group_snapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: created successfully Apr 28 15:14:41 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:14:41 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:42 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: deleting Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 0.836s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: deleting {{(pid=84270) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 15:14:42 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e 1G Apr 28 15:14:42 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-26f11443-81e5-4625-ba24-4e033b498d87" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-26f11443-81e5-4625-ba24-4e033b498d87" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Deleting offline snapshot 26f11443-81e5-4625-ba24-4e033b498d87 of volume 0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] snapshot_file for this snap is: volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a52e20-0d1a-4ebb-837b-a77312617cc5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:42 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 Apr 28 15:14:42 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:43 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e 1G" returned: 0 in 1.111s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:43 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:14:43 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:43 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87" returned: 0 in 1.104s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd87795f-61e6-47b1-8e5b-c00511ee5c82]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:43 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 Apr 28 15:14:43 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:44 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 1.215s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:44 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e is being set with open permissions: ugo+rw Apr 28 15:14:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:44 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" returned: 0 in 1.038s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:44 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:14:44 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:44 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 Apr 28 15:14:44 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:45 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 0.968s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:45 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info Apr 28 15:14:45 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:45 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87" returned: 0 in 1.077s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:45 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87 Apr 28 15:14:45 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:46 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233.26f11443-81e5-4625-ba24-4e033b498d87" returned: 0 in 0.991s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:46 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info" returned: 0 in 1.172s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:46 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info is being set with open permissions: ugo+rw Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-26f11443-81e5-4625-ba24-4e033b498d87" released by "_delete_snapshot" :: held 4.424s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" released by "delete_snapshot" :: held 4.466s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:46 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info Apr 28 15:14:46 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-76536074-b439-4083-9d3f-86f0f160be2f" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-76536074-b439-4083-9d3f-86f0f160be2f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Deleting offline snapshot 76536074-b439-4083-9d3f-86f0f160be2f of volume 6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] snapshot_file for this snap is: volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ae54c-c72e-4433-8407-15b15cfae950]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:47 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f Apr 28 15:14:47 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:47 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.info" returned: 0 in 0.965s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] snapshot: ff981b84-d921-46a9-b696-35b844a0408e, volume: db679a93-ffcc-48bb-881f-e5e083843d87, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf1c7c2-3224-4f44-94e6-4de588fa74e7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:47 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f" returned: 0 in 0.917s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f58f532-9ded-47d4-8621-b5a4564b33dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90a85f-25bc-46ae-8de0-2421c1fc76d7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:47 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:14:48 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:48 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd Apr 28 15:14:48 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:48 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd" returned: 0 in 0.913s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:48 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 1.003s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ceb0ac-866d-4732-8424-9b08cd49afa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:14:48 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f Apr 28 15:14:48 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0ef06-0952-423f-8c70-9dd713ff3d2b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:49 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:14:49 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:49 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 0.918s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:49 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:14:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:49 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 Apr 28 15:14:49 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:49 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f" returned: 0 in 1.000s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:49 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f Apr 28 15:14:49 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:50 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:50 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:50 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd.76536074-b439-4083-9d3f-86f0f160be2f" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-76536074-b439-4083-9d3f-86f0f160be2f" released by "_delete_snapshot" :: held 3.720s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" released by "delete_snapshot" :: held 3.776s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:50 devstack cinder-volume[84270]: WARNING cinder.quota [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1909496179 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1909496179, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:50 devstack cinder-volume[84270]: WARNING cinder.quota [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1909496179 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1909496179, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:50 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['b1275413-7162-4aa8-95c2-3e3b0a45f338', 'c960548f-204f-4d5d-93b2-65179b87ea96', '418186ad-a666-4a75-86e3-09e5e80f0c84', '2882594f-2912-425b-a4e1-803a273ed90d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:51 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['e1fe1341-c421-4a41-9951-80d5d2936d2a', 'ca9b7749-4078-43c7-a4ae-3a0641e1963a', 'a046619c-aab3-4bb2-be00-f3a9e8be02a7', 'e94ce678-aa03-4ada-b959-0baa270306ee'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:51 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-59809296-b683-4acd-8773-57d4b8274126 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot bdda61d1-03c2-44ea-a2ae-0b536fb0ec31: deleted successfully Apr 28 15:14:52 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.774s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:14:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" acquired by "delete_volume" :: waited 0.052s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce932d51-2a83-4621-9b18-055a5ebaad73]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:53 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 Apr 28 15:14:53 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:55 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" returned: 0 in 2.200s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:55 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233 Apr 28 15:14:55 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:56 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" returned: 0 in 1.472s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-0b3229d4-4e4c-4d6b-b5d3-03669ac09233" released by "delete_volume" :: held 3.853s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77d1bc-3614-4ebd-a96a-92b01583b829]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:57 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87" returned: 0 in 7.227s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:57 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[354d1ccc-a37d-4816-941e-c06e7a177dc1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:57 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd Apr 28 15:14:57 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:57 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:14:57 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:57 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd" returned: 0 in 1.005s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:58 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd Apr 28 15:14:58 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:58 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 1.361s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:58 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:14:58 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Converted 1024.00 MB image at 141.61 MB/s Apr 28 15:14:58 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 is being set with open permissions: ugo+rw Apr 28 15:14:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:58 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 Apr 28 15:14:58 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:58 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6f58f532-9ded-47d4-8621-b5a4564b33dd" returned: 0 in 0.925s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-6f58f532-9ded-47d4-8621-b5a4564b33dd" released by "delete_volume" :: held 2.027s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['687500f3-1065-49fe-a56f-53ee98278a25'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:59 devstack cinder-volume[84270]: WARNING cinder.quota [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1909496179 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1909496179, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['2edda528-f231-4e54-b2be-1a8a80585eec', 'b7211c0d-3b68-4d8b-8bbe-f8872e894c75', 'ae85805b-83e3-412b-80e5-8c20e82a1cac', 'e19a775f-f857-49b7-9143-6a87b586f199'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:59 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87" returned: 0 in 0.771s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" released by "_copy_volume_from_snapshot" :: held 11.453s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-quobyte-ff981b84-d921-46a9-b696-35b844a0408e" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['d0df8241-1d4a-4574-9d87-bc579a1b9c0e', '6c736612-a1e8-4645-9d85-9cbb46be5d61', 'bc376614-d286-4e2e-ae7f-c044c355ab30', '31562b3f-8797-4401-b9ff-6ad1f6d06bb2'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-ff981b84-d921-46a9-b696-35b844a0408e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Deleting offline snapshot ff981b84-d921-46a9-b696-35b844a0408e of volume 62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] snapshot_file for this snap is: volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc37c4f-cef8-4f4d-8f77-e022afa0b8bd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:59 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:14:59 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:14:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:14:59 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:14:59 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-617aa3fd-a3e9-4995-b66b-2816165b3e36 tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-539527900: creating Apr 28 15:15:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-617aa3fd-a3e9-4995-b66b-2816165b3e36 tempest-GroupSnapshotsTest-1328565825 None] Group tempest-GroupSnapshotsTest-Group-539527900: created successfully Apr 28 15:15:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-617aa3fd-a3e9-4995-b66b-2816165b3e36 tempest-GroupSnapshotsTest-1328565825 None] Create group completed successfully. Apr 28 15:15:00 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.135s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-207e36a9-ac80-461c-981b-2b891605f6c0 tempest-GroupSnapshotsTest-1328565825 None] Delete group completed successfully. Apr 28 15:15:00 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 1.403s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ceb0ac-866d-4732-8424-9b08cd49afa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11dc24-4fca-4504-b967-29d7da27c1ee]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:00 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:15:00 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:01 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 1.113s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:01 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:15:01 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (5d634bdf-384c-417e-ac07-19f20e4ad657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0339f3dc-b7c5-4077-9701-5ddb7c3b4b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0339f3dc-b7c5-4077-9701-5ddb7c3b4b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184014029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb652713-fd2a-4611-92e2-d3ed76a40021,host='devstack@QuobyteHD#QuobyteHD',id=a90122ab-1ebc-4fe4-b9ff-6d82170fc334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:03Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7901da58-ba58-4b78-a15e-93025cd08df4),volume_type_id=7901da58-ba58-4b78-a15e-93025cd08df4)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed23c89-637f-4d08-bcda-e286e8daaa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed23c89-637f-4d08-bcda-e286e8daaa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c2194-3cb9-400f-b510-91813b1dd78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c2194-3cb9-400f-b510-91813b1dd78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90122ab-1ebc-4fe4-b9ff-6d82170fc334', 'volume_name': 'volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20284b0-33eb-4d8c-9d5a-46562c1636c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20284b0-33eb-4d8c-9d5a-46562c1636c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136b0c52-283e-4184-8c41-5275dbc8fd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:02 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Volume a90122ab-1ebc-4fe4-b9ff-6d82170fc334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334', 'volume_size': 1} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:02 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 1.082s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:03 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e Apr 28 15:15:03 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:03 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6.ff981b84-d921-46a9-b696-35b844a0408e" returned: 0 in 0.837s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-ff981b84-d921-46a9-b696-35b844a0408e" released by "_delete_snapshot" :: held 4.562s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.548s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb652713-fd2a-4611-92e2-d3ed76a40021,created_at=2026-04-28T13:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184014029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb652713-fd2a-4611-92e2-d3ed76a40021,host='devstack@QuobyteHD#QuobyteHD',id=a90122ab-1ebc-4fe4-b9ff-6d82170fc334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13690e76cca3447291d77945af7f349a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:03Z,use_quota=True,user_id='f3f50a3257654f249ddd844049c6f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7901da58-ba58-4b78-a15e-93025cd08df4),volume_type_id=7901da58-ba58-4b78-a15e-93025cd08df4)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Creating volume a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:03 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:03 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 1073741824 Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d3639-5f84-4fd6-ad9f-bd1bd06d28ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db679a93-ffcc-48bb-881f-e5e083843d87', 'volume_size': 2, 'source_volid': '62ceb0ac-866d-4732-8424-9b08cd49afa6', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:03 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45856dc-c9bf-40df-8cfd-e3420dcd42f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Volume volume-db679a93-ffcc-48bb-881f-e5e083843d87 (db679a93-ffcc-48bb-881f-e5e083843d87): created successfully Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45856dc-c9bf-40df-8cfd-e3420dcd42f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Flow 'volume_create_manager' (205f2537-bbed-456c-a8e5-87402ee77732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a44d11df-cd1b-4908-aea1-ed9f2547d9da tempest-VolumesCloneTest-795630154 None] Created volume successfully. Apr 28 15:15:04 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 1073741824" returned: 0 in 0.757s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:04 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 Apr 28 15:15:04 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-db679a93-ffcc-48bb-881f-e5e083843d87-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "cinder-db679a93-ffcc-48bb-881f-e5e083843d87-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" acquired by "delete_volume" :: waited 0.040s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863956f-0e92-4261-8414-14f8bd216c3f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:05 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 Apr 28 15:15:05 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:05 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" returned: 0 in 0.830s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136b0c52-283e-4184-8c41-5275dbc8fd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d9705-599d-4c40-9e56-743aabf6f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:05 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Volume volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 (a90122ab-1ebc-4fe4-b9ff-6d82170fc334): created successfully Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d9705-599d-4c40-9e56-743aabf6f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Flow 'volume_create_manager' (5d634bdf-384c-417e-ac07-19f20e4ad657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-88717440-d6d0-4522-b02a-d2208485aa0f tempest-GroupSnapshotsTest-1328565825 None] Created volume successfully. Apr 28 15:15:06 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87" returned: 0 in 0.929s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:06 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87 Apr 28 15:15:06 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:06 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] GroupSnapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: creating. Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Group snapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: creating. {{(pid=84270) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Creating offline snapshot 32380506-bce0-4242-bcef-666252e1e102 of volume a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21f64c-0ef8-4856-9963-409e28800308]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:06 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 Apr 28 15:15:06 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:07 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db679a93-ffcc-48bb-881f-e5e083843d87" returned: 0 in 0.976s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-db679a93-ffcc-48bb-881f-e5e083843d87" released by "delete_volume" :: held 1.986s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Created reservations ['38a5bf37-1ca7-4079-b7d7-4792e1399002', 'b99c93e0-9b94-49d1-aef1-ca91cdd8c437', 'c5e23018-d67a-449b-938f-a7d79536f30a', '927da8c6-b220-46e4-aae2-ed8f1e2c694e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:07 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:07 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:07 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" returned: 0 in 1.099s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:07 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 1G Apr 28 15:15:07 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:08 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.096s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-62ceb0ac-866d-4732-8424-9b08cd49afa6-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Deleted volume successfully. Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e99c89d4-8fe8-43ae-9be0-b390539a3775 tempest-VolumesCloneTest-795630154 None] Lock "cinder-db679a93-ffcc-48bb-881f-e5e083843d87-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "cinder-62ceb0ac-866d-4732-8424-9b08cd49afa6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Acquiring lock "cinder-quobyte-62ceb0ac-866d-4732-8424-9b08cd49afa6" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-62ceb0ac-866d-4732-8424-9b08cd49afa6" acquired by "delete_volume" :: waited 0.113s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8fafb5-b993-44ca-855b-61778c845165]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:09 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 1G" returned: 0 in 1.431s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:09 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 Apr 28 15:15:09 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:09 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:15:09 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:10 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102" returned: 0 in 1.383s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:10 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:15:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:10 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 Apr 28 15:15:10 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:10 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 1.971s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:10 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6 Apr 28 15:15:10 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:11 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102" returned: 0 in 0.836s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:11 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info Apr 28 15:15:11 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:12 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-62ceb0ac-866d-4732-8424-9b08cd49afa6" returned: 0 in 1.277s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "cinder-quobyte-62ceb0ac-866d-4732-8424-9b08cd49afa6" released by "delete_volume" :: held 3.378s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Created reservations ['636b0d74-3d7c-4884-ad16-1ff6ced9b1f0', 'a5113c94-6338-46ca-83d0-50103857e142', '9bbb716c-8e6a-4165-a417-2cc6a0ea1851', 'c90fe343-af8a-44d3-865e-f9ea454e2151'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:12 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info" returned: 0 in 0.930s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:12 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:12 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info Apr 28 15:15:12 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:12 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:12 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:13 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.info" returned: 0 in 0.827s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.681s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0397cb3a-2abd-4398-8141-a50bea3c83e3 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: created successfully Apr 28 15:15:13 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.303s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:13 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Deleted volume successfully. Apr 28 15:15:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ea02cea7-7778-4061-bda4-fa4f9b896544 tempest-VolumesCloneTest-795630154 None] Lock "cinder-62ceb0ac-866d-4732-8424-9b08cd49afa6-delete_volume" released by "delete_volume" :: held 5.212s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: deleting Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: deleting {{(pid=84270) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" acquired by "delete_snapshot" :: waited 0.043s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-32380506-bce0-4242-bcef-666252e1e102" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-32380506-bce0-4242-bcef-666252e1e102" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Deleting offline snapshot 32380506-bce0-4242-bcef-666252e1e102 of volume a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] snapshot_file for this snap is: volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130fb07-edca-4e4b-9dee-6e7552510878]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:14 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 Apr 28 15:15:14 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:15 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102" returned: 0 in 1.112s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:15:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3173445-ff3f-453a-abe8-96dcc089a828]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:16 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 Apr 28 15:15:16 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:17 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" returned: 0 in 1.119s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:17 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 Apr 28 15:15:17 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:18 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102" returned: 0 in 1.430s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:18 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102 Apr 28 15:15:18 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Flow 'volume_create_manager' (8e7bc3df-1077-4c2f-82bf-0cf6e2c0ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d08f4b-4967-4449-98da-8f817d41cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d08f4b-4967-4449-98da-8f817d41cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1641317586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b201860f-7d90-459d-892f-4e750dd7b592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa5bfbb12f54ab181395cf543bab21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:19Z,use_quota=True,user_id='738e31fac69c4480b3d15e9ef4a7194f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161c5317-7fc6-4b2d-8593-8f1673794585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161c5317-7fc6-4b2d-8593-8f1673794585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e88342-8bd3-456a-b2af-22d81264f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e88342-8bd3-456a-b2af-22d81264f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b201860f-7d90-459d-892f-4e750dd7b592', 'volume_name': 'volume-b201860f-7d90-459d-892f-4e750dd7b592', 'volume_size': 2}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c01d4cb-ba2c-4e00-ab8e-0e66752e8b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c01d4cb-ba2c-4e00-ab8e-0e66752e8b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c799bd-4ce8-4c8d-8e6a-d4ee56be65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:18 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Volume b201860f-7d90-459d-892f-4e750dd7b592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b201860f-7d90-459d-892f-4e750dd7b592', 'volume_size': 2} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1641317586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b201860f-7d90-459d-892f-4e750dd7b592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa5bfbb12f54ab181395cf543bab21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:19Z,use_quota=True,user_id='738e31fac69c4480b3d15e9ef4a7194f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Creating volume b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:18 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 2147483648 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:18 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 2147483648 Apr 28 15:15:18 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:19 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334.32380506-bce0-4242-bcef-666252e1e102" returned: 0 in 1.326s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-32380506-bce0-4242-bcef-666252e1e102" released by "_delete_snapshot" :: held 5.165s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" released by "delete_snapshot" :: held 5.192s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:20 devstack cinder-volume[84270]: WARNING cinder.quota [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1180402837 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1180402837, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:15:20 devstack cinder-volume[84270]: WARNING cinder.quota [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1180402837 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1180402837, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:15:20 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['dfa9a8f6-5c00-4cfd-a997-f5f3c84b6412', '4fee2f15-14f4-4b87-84ea-8e7378bc9741', '6bf97d14-c24a-403f-8d60-dd73d177aa58', '8af54fc5-62e3-4fe5-9625-cc3a1469c3e0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d5464e9f-2635-4bcc-b6ea-28c08572c567 tempest-GroupSnapshotsTest-1328565825 None] group_snapshot 79609907-5d1e-4b94-9c50-b8b573439e2d: deleted successfully Apr 28 15:15:20 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 2147483648" returned: 0 in 1.648s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:20 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 Apr 28 15:15:20 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Flow 'volume_create_manager' (99748f3a-f19d-4bad-854c-6daf04969000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb050d-0dbf-4918-bda7-406c07aa5dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb050d-0dbf-4918-bda7-406c07aa5dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b64103-1f64-408f-9b52-e0f42e75f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab905c6f4d2d4ff183302447de36e4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:21Z,use_quota=True,user_id='6d4fdf1f787c405ea484f538a81ebcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226ea46-dc0d-4892-bc03-cc70b6d25f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226ea46-dc0d-4892-bc03-cc70b6d25f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b17f19-67b4-41b1-b016-d2886508d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.image.glance [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Creating Keystone auth plugin from conf {{(pid=84270) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:21 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592" returned: 0 in 1.341s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] <== create_volume: return (3083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.088s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" acquired by "delete_volume" :: waited 0.210s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c799bd-4ce8-4c8d-8e6a-d4ee56be65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b201860f-7d90-459d-892f-4e750dd7b592', 'volume_size': 2}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c499fb07-8d52-4880-a831-1b5f050be2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba89862-4be3-41fd-b87e-c5053fcc8385]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Volume volume-b201860f-7d90-459d-892f-4e750dd7b592 (b201860f-7d90-459d-892f-4e750dd7b592): created successfully Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c499fb07-8d52-4880-a831-1b5f050be2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Flow 'volume_create_manager' (8e7bc3df-1077-4c2f-82bf-0cf6e2c0ea14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ae540bb6-7c8e-47d3-bf26-5e4f3ec92fc4 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Created volume successfully. Apr 28 15:15:22 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 Apr 28 15:15:22 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b17f19-67b4-41b1-b016-d2886508d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56b64103-1f64-408f-9b52-e0f42e75f249', 'volume_name': 'volume-56b64103-1f64-408f-9b52-e0f42e75f249', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8699f1c-dda4-4216-aec4-74dc6009b584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8699f1c-dda4-4216-aec4-74dc6009b584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64265c-25b4-4ae2-9c11-3b33eabab08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume 56b64103-1f64-408f-9b52-e0f42e75f249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56b64103-1f64-408f-9b52-e0f42e75f249', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 15:15:22 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Trying to clone 56b64103-1f64-408f-9b52-e0f42e75f249 from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]). {{(pid=84270) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 15:15:23 devstack cinder-volume[84270]: INFO cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Image download 20.69 MB at 20.69 MB/s Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8060750-5c36-43de-a5c3-9e3b595a1624]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=90,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=3 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=79,cinder:DELETE=5,cinder:SELECT=80,cinder:INSERT=19 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Creating offline snapshot 75452209-1ae4-4e59-be0d-72bbc69b38ab of volume b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:15:24 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[17715919-44d3-4c65-9b6c-6767625a0855]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:24 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD Apr 28 15:15:24 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:24 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" returned: 0 in 2.015s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:24 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334 Apr 28 15:15:24 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:24 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 Apr 28 15:15:24 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:25 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD" returned: 0 in 1.488s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e is fetched for user 6d4fdf1f787c405ea484f538a81ebcb8. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 15:15:25 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" returned: 0 in 1.058s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:25 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64108c8-fb52-4b54-b58f-a723e908b088]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592" returned: 0 in 1.168s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab 2G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Lock "cinder-quobyte-a90122ab-1ebc-4fe4-b9ff-6d82170fc334" released by "delete_volume" :: held 3.212s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:25 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab 2G Apr 28 15:15:25 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['597ca057-dc42-4aa7-9af6-08a15c99db07'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:25 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD Apr 28 15:15:25 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:25 devstack cinder-volume[84270]: WARNING cinder.quota [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1180402837 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1180402837, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Created reservations ['d508ee95-2235-4688-ba6e-795e73e3c212', '5dd0d1b5-ed34-46a8-9fda-d21a6520224f', 'ff4b9399-e965-4573-b5dc-062f48565ff1', '9bdfcf77-5280-4b49-adcc-cb5f4d2e15ea'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:25 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:25 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD" returned: 0 in 1.217s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:26 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:26 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab 2G" returned: 0 in 1.290s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b201860f-7d90-459d-892f-4e750dd7b592 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:26 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b201860f-7d90-459d-892f-4e750dd7b592 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab Apr 28 15:15:26 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:26 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.066s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:26 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a726cfa4-2a09-48dd-8069-e8e00c5e28f1 tempest-GroupSnapshotsTest-1328565825 None] Delete group completed successfully. Apr 28 15:15:27 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b201860f-7d90-459d-892f-4e750dd7b592 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab" returned: 0 in 0.665s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:27 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab is being set with open permissions: ugo+rw Apr 28 15:15:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:27 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab Apr 28 15:15:27 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:27 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab" returned: 0 in 0.655s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:27 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info Apr 28 15:15:27 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:28 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info" returned: 0 in 0.687s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:28 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info is being set with open permissions: ugo+rw Apr 28 15:15:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:28 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info Apr 28 15:15:28 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:29 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.info" returned: 0 in 0.649s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.283s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b64103-1f64-408f-9b52-e0f42e75f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab905c6f4d2d4ff183302447de36e4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:21Z,use_quota=True,user_id='6d4fdf1f787c405ea484f538a81ebcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Creating volume 56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:29 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:29 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1073741824 Apr 28 15:15:29 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f72305b6-c862-4eef-beb8-8ceefa899ab0 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Create snapshot completed successfully Apr 28 15:15:30 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "cinder-75452209-1ae4-4e59-be0d-72bbc69b38ab-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1073741824" returned: 0 in 1.043s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-75452209-1ae4-4e59-be0d-72bbc69b38ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "cinder-quobyte-75452209-1ae4-4e59-be0d-72bbc69b38ab" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-75452209-1ae4-4e59-be0d-72bbc69b38ab" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Deleting offline snapshot 75452209-1ae4-4e59-be0d-72bbc69b38ab of volume b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:15:30 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:30 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] snapshot_file for this snap is: volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4cfea-ab41-41af-848b-ad7b8e8dbef4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:30 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab Apr 28 15:15:30 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:31 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 1.044s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Attempting download of e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 56b64103-1f64-408f-9b52-e0f42e75f249. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672f41d-e3e5-4472-845d-12225af8bae0]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:31 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab" returned: 0 in 1.473s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b201860f-7d90-459d-892f-4e750dd7b592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:15:32 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e Apr 28 15:15:32 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:32 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c68610-0698-46b3-9c41-0790fbdddab6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:32 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 Apr 28 15:15:32 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:33 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e" returned: 0 in 1.431s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:33 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e Apr 28 15:15:33 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:33 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592" returned: 0 in 1.474s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:33 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab Apr 28 15:15:33 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:34 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab" returned: 0 in 1.118s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:34 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab Apr 28 15:15:34 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:34 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e" returned: 1 in 1.902s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_dmr8nr0e' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[0125a88f-3094-4aab-8898-a9ce5ad01757]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:35 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD Apr 28 15:15:35 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:35 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592.75452209-1ae4-4e59-be0d-72bbc69b38ab" returned: 0 in 1.268s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-75452209-1ae4-4e59-be0d-72bbc69b38ab" released by "_delete_snapshot" :: held 5.615s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" released by "delete_snapshot" :: held 5.660s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Created reservations ['cadcb05b-a852-4fae-bfde-8c3d3ec0526e', 'ad072b41-1340-4d01-923f-a22ae6928ab2', 'd421fb6a-4bdd-4a7c-8957-a501a0e58809', 'f896e3f9-6843-4042-8097-9e6109fceecf'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:36 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Delete snapshot completed successfully. Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0aa27ff9-d8f5-42a4-b47f-a709e14e1c5b tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-75452209-1ae4-4e59-be0d-72bbc69b38ab-delete_snapshot" released by "delete_snapshot" :: held 5.911s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:36 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD" returned: 0 in 1.469s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e was qcow2, converting to raw {{(pid=84270) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 15:15:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:36 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:36 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "cinder-b201860f-7d90-459d-892f-4e750dd7b592-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-b201860f-7d90-459d-892f-4e750dd7b592-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" acquired by "delete_volume" :: waited 0.044s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae08fa35-7d4f-473b-be81-3c74c7353871]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:37 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 Apr 28 15:15:37 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:38 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592" returned: 0 in 1.008s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:38 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592 Apr 28 15:15:38 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:39 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b201860f-7d90-459d-892f-4e750dd7b592" returned: 0 in 0.870s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-quobyte-b201860f-7d90-459d-892f-4e750dd7b592" released by "delete_volume" :: held 1.995s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Created reservations ['cfdf735f-8a59-42b4-94f6-f13d88957912', 'ee07479b-338e-43a6-8b87-7284e3d88c9e', '93336608-3e64-4460-a021-c7d10b06f7db', '75f45f0e-2ca7-4477-b57a-31932fbc3fc0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:39 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 2.812s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_0dubuvw9devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:15:39 devstack cinder-volume[84270]: INFO cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Converted 112.00 MB image at 39.81 MB/s Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:39 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1G Apr 28 15:15:39 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:39 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:39 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:40 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 1G" returned: 0 in 0.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd99d3fe-b9bc-4108-88f3-d1b8d945d323]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:40 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.769s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Deleted volume successfully. Apr 28 15:15:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a7c09cb2-060a-499e-bb23-fffb66104883 tempest-VolumesSnapshotNegativeTestJSON-122472406 None] Lock "cinder-b201860f-7d90-459d-892f-4e750dd7b592-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:15:40 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:40 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:41 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 1.421s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:41 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:41 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8f4a67c4-e9f9-403c-862a-9cef1711ec0f tempest-GroupsV320Test-1649124038 None] Group tempest-GroupsV320Test-Group-1164456746: creating Apr 28 15:15:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8f4a67c4-e9f9-403c-862a-9cef1711ec0f tempest-GroupsV320Test-1649124038 None] Group tempest-GroupsV320Test-Group-1164456746: created successfully Apr 28 15:15:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8f4a67c4-e9f9-403c-862a-9cef1711ec0f tempest-GroupsV320Test-1649124038 None] Create group completed successfully. Apr 28 15:15:42 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 1 in 0.941s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Downloaded image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 56b64103-1f64-408f-9b52-e0f42e75f249 successfully. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e for user 6d4fdf1f787c405ea484f538a81ebcb8 is deleted. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Marking volume 56b64103-1f64-408f-9b52-e0f42e75f249 as bootable. {{(pid=84270) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Copying metadata from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e to 56b64103-1f64-408f-9b52-e0f42e75f249. {{(pid=84270) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Creating volume glance metadata for volume 56b64103-1f64-408f-9b52-e0f42e75f249 backed by image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84270) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64265c-25b4-4ae2-9c11-3b33eabab08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b64103-1f64-408f-9b52-e0f42e75f249', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826c6045-1ea8-472c-abcb-ebd0a3dab11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:42 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Volume volume-56b64103-1f64-408f-9b52-e0f42e75f249 (56b64103-1f64-408f-9b52-e0f42e75f249): created successfully Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826c6045-1ea8-472c-abcb-ebd0a3dab11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Flow 'volume_create_manager' (99748f3a-f19d-4bad-854c-6daf04969000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-d65903d6-b935-4c21-b1ab-53cb363814b9 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Created volume successfully. Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Created reservations ['b492911a-5cac-43b9-8b78-c18229b1492a'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (a9aa276d-30e8-48ee-a397-b2f4bc1489fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eee168-96d9-4882-af0b-03b74b159c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eee168-96d9-4882-af0b-03b74b159c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896830728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9ea89-235c-40e1-8314-0c6773ab218b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ac6f4-f0ea-4138-ad9d-4683711f808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ac6f4-f0ea-4138-ad9d-4683711f808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92331b5-7137-456d-be04-6c8628388760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92331b5-7137-456d-be04-6c8628388760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c9ea89-235c-40e1-8314-0c6773ab218b', 'volume_name': 'volume-56c9ea89-235c-40e1-8314-0c6773ab218b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33717ab4-f71c-4d23-b4cb-6064094ab762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33717ab4-f71c-4d23-b4cb-6064094ab762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418158a7-22eb-43a4-9744-c109b82a2d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:43 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Volume 56c9ea89-235c-40e1-8314-0c6773ab218b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c9ea89-235c-40e1-8314-0c6773ab218b', 'volume_size': 1} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896830728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9ea89-235c-40e1-8314-0c6773ab218b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Creating volume 56c9ea89-235c-40e1-8314-0c6773ab218b {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:43 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:43 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b 1073741824 Apr 28 15:15:43 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:43 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:43 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (8d4ba125-708a-4a11-9234-4858ddb775bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ca76f8-d18f-433f-bb50-0c619a21fc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Flow 'volume_create_manager' (1b3f747e-8d45-4048-b4c9-0a4226c35988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b861dd-ee84-40d8-a5dd-658a4c7ba247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b861dd-ee84-40d8-a5dd-658a4c7ba247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1494347299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e6395-2537-48e2-b98b-a14b694a543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9779f81b40474ddfa0fd81d1c86ee459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='692a7ede836a475e90288602594b94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767bb59-02e8-4f2f-9a7f-e11315c908d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767bb59-02e8-4f2f-9a7f-e11315c908d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b030fd82-7d5a-445a-907d-dd09a9ffc014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b030fd82-7d5a-445a-907d-dd09a9ffc014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4e6395-2537-48e2-b98b-a14b694a543d', 'volume_name': 'volume-7a4e6395-2537-48e2-b98b-a14b694a543d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74129dc-fcc4-48f1-a4fb-3972d9c8bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74129dc-fcc4-48f1-a4fb-3972d9c8bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6200a8-33cf-40dd-b5b6-a4f007640ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Volume 7a4e6395-2537-48e2-b98b-a14b694a543d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4e6395-2537-48e2-b98b-a14b694a543d', 'volume_size': 1} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ca76f8-d18f-433f-bb50-0c619a21fc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230991052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0115022-d533-471a-a5c1-f3fcf333ef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835e2edf-4aa0-4b7d-a7fc-af7bd9afe7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835e2edf-4aa0-4b7d-a7fc-af7bd9afe7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8185df0d-78e6-4ed6-bd05-59557257a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8185df0d-78e6-4ed6-bd05-59557257a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0115022-d533-471a-a5c1-f3fcf333ef3e', 'volume_name': 'volume-e0115022-d533-471a-a5c1-f3fcf333ef3e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90450a63-8663-4da8-b591-fe39c5f3dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90450a63-8663-4da8-b591-fe39c5f3dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bc9396-0dd6-4385-a72b-ff2254033de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Volume e0115022-d533-471a-a5c1-f3fcf333ef3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0115022-d533-471a-a5c1-f3fcf333ef3e', 'volume_size': 1} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:44 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (98d86782-b39e-431f-93f6-8132023e2ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6af57-d263-4e60-925a-4e6c90f2b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.969s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c18a483a-a784-45e8-8336-7c1b9ed07f3c tempest-GroupsV320Test-1649124038 None] Delete group completed successfully. Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6af57-d263-4e60-925a-4e6c90f2b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003579424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e0d690-df5e-4d24-b975-4fcaa5c0028e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:45Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d71195-bb2e-42d4-a406-9c5d298b1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d71195-bb2e-42d4-a406-9c5d298b1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e12f034-cfa6-45e2-a305-e2c57f6a4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e12f034-cfa6-45e2-a305-e2c57f6a4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e0d690-df5e-4d24-b975-4fcaa5c0028e', 'volume_name': 'volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc143f9f-87fc-49d7-8127-35fbd811e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc143f9f-87fc-49d7-8127-35fbd811e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94065a7a-7617-4e8b-a0e3-e777e2889aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Volume 38e0d690-df5e-4d24-b975-4fcaa5c0028e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e', 'volume_size': 1} Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:44 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b 1073741824" returned: 0 in 1.159s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:45 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b Apr 28 15:15:45 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (4e848b6a-0838-4373-9355-f172401bac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ae7b46-24d3-456f-9f5c-ac460577ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ae7b46-24d3-456f-9f5c-ac460577ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-876926627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93291bf4-ebed-44ff-bdc5-267e16d7782d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:45Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8794ac25-0b59-42e0-94c4-0f138a0a0a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8794ac25-0b59-42e0-94c4-0f138a0a0a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5251f9-8d89-4958-b3b2-630eb5e52539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5251f9-8d89-4958-b3b2-630eb5e52539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93291bf4-ebed-44ff-bdc5-267e16d7782d', 'volume_name': 'volume-93291bf4-ebed-44ff-bdc5-267e16d7782d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ad4aec-adb0-44a1-82f9-b82713bb9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ad4aec-adb0-44a1-82f9-b82713bb9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd050052-02e6-4ae4-b925-54858afeeb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Volume 93291bf4-ebed-44ff-bdc5-267e16d7782d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93291bf4-ebed-44ff-bdc5-267e16d7782d', 'volume_size': 1} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (366d092a-92ae-4569-988b-2ffe6ed32947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fdb9f5-dc5a-4060-b586-608a24b9260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fdb9f5-dc5a-4060-b586-608a24b9260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438133623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031d8b42-b4a2-40b3-a789-391424ba1daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:46Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dd98c1-7226-458d-b00d-a203bdc83c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dd98c1-7226-458d-b00d-a203bdc83c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c862b969-3536-4b3c-bf0c-99bcd865d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c862b969-3536-4b3c-bf0c-99bcd865d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031d8b42-b4a2-40b3-a789-391424ba1daf', 'volume_name': 'volume-031d8b42-b4a2-40b3-a789-391424ba1daf', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25ce794-548d-476d-a863-b654399ca228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25ce794-548d-476d-a863-b654399ca228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05171df1-1174-459b-9c3f-9fa14621ca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Volume 031d8b42-b4a2-40b3-a789-391424ba1daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031d8b42-b4a2-40b3-a789-391424ba1daf', 'volume_size': 1} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.588s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418158a7-22eb-43a4-9744-c109b82a2d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c9ea89-235c-40e1-8314-0c6773ab218b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0ad651-f28c-481c-8163-25332e4ebb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:45 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Volume volume-56c9ea89-235c-40e1-8314-0c6773ab218b (56c9ea89-235c-40e1-8314-0c6773ab218b): created successfully Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0ad651-f28c-481c-8163-25332e4ebb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (a9aa276d-30e8-48ee-a397-b2f4bc1489fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[beedfa0d-4e11-4531-b6a6-0514dbc38e1e]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:45 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0934b74a-3f2b-4b32-9acd-758023b877d1 tempest-CreateVolumesFromImageTest-452738226 None] Created volume successfully. Apr 28 15:15:45 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:45 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:46 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 0.733s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:46 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:15:46 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:47 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 1 in 0.808s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.595s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1494347299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e6395-2537-48e2-b98b-a14b694a543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9779f81b40474ddfa0fd81d1c86ee459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='692a7ede836a475e90288602594b94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Creating volume 7a4e6395-2537-48e2-b98b-a14b694a543d {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:47 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:47 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d 1073741824 Apr 28 15:15:47 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353', 'name': 'volume-56b64103-1f64-408f-9b52-e0f42e75f249', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58050df6-fc18-489a-8872-90d534c29c5d', 'enforce_multipath': True} {{(pid=84270) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 15:15:47 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-38fd5ffd-366d-4f9c-b6d3-2ac1328c862e req-304f392a-4a9b-4ba6-9b9c-795fffae3dd2 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] attachment_update completed successfully. Apr 28 15:15:48 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d 1073741824" returned: 0 in 0.943s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:48 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d Apr 28 15:15:48 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:48 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d" returned: 0 in 0.693s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.468s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230991052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0115022-d533-471a-a5c1-f3fcf333ef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:44Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Creating volume e0115022-d533-471a-a5c1-f3fcf333ef3e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:49 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:49 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e 1073741824 Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6200a8-33cf-40dd-b5b6-a4f007640ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4e6395-2537-48e2-b98b-a14b694a543d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:49 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca507fb0-276a-4ed7-94ad-cbd0907d9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:49 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Volume volume-7a4e6395-2537-48e2-b98b-a14b694a543d (7a4e6395-2537-48e2-b98b-a14b694a543d): created successfully Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca507fb0-276a-4ed7-94ad-cbd0907d9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Flow 'volume_create_manager' (1b3f747e-8d45-4048-b4c9-0a4226c35988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:49 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cc05062c-9834-4f2c-9312-ed5879bfab45 tempest-ServersNegativeTestJSON-1076230715 None] Created volume successfully. Apr 28 15:15:49 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e 1073741824" returned: 0 in 0.842s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:49 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e Apr 28 15:15:49 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:50 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:15:50 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:50 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e" returned: 0 in 0.858s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.852s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003579424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e0d690-df5e-4d24-b975-4fcaa5c0028e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:45Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Creating volume 38e0d690-df5e-4d24-b975-4fcaa5c0028e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:50 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:50 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e 1073741824 Apr 28 15:15:50 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bc9396-0dd6-4385-a72b-ff2254033de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0115022-d533-471a-a5c1-f3fcf333ef3e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042982d3-d9b5-4e8e-88db-f6e5ce77e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Volume volume-e0115022-d533-471a-a5c1-f3fcf333ef3e (e0115022-d533-471a-a5c1-f3fcf333ef3e): created successfully Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042982d3-d9b5-4e8e-88db-f6e5ce77e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (8d4ba125-708a-4a11-9234-4858ddb775bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-610e94a0-9d50-4add-991f-f076050feb6f tempest-CreateVolumesFromImageTest-452738226 None] Created volume successfully. Apr 28 15:15:51 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.897s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Flow 'volume_create_manager' (370418b3-6681-4d0a-894e-b6c296a1d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabeb493-8944-40ea-b87a-2f2807832d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabeb493-8944-40ea-b87a-2f2807832d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993701180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29da10b9-a18b-47ce-b6e1-b2e384ffa172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9779f81b40474ddfa0fd81d1c86ee459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:52Z,use_quota=True,user_id='692a7ede836a475e90288602594b94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48222409-bb1a-4269-8f47-6e5676d92f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48222409-bb1a-4269-8f47-6e5676d92f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee22fe-0951-43c1-8046-c13808981a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee22fe-0951-43c1-8046-c13808981a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29da10b9-a18b-47ce-b6e1-b2e384ffa172', 'volume_name': 'volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e6599c-0529-4777-8ecc-dafb41e7b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e6599c-0529-4777-8ecc-dafb41e7b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1946aa-7677-492b-852d-61f169a8639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:51 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Volume 29da10b9-a18b-47ce-b6e1-b2e384ffa172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172', 'volume_size': 1} Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:51 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e 1073741824" returned: 0 in 1.201s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:52 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e Apr 28 15:15:52 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:53 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e" returned: 0 in 1.087s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.834s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-876926627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93291bf4-ebed-44ff-bdc5-267e16d7782d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:45Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Creating volume 93291bf4-ebed-44ff-bdc5-267e16d7782d {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:53 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:53 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d 1073741824 Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94065a7a-7617-4e8b-a0e3-e777e2889aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:53 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29757c15-3ba3-43eb-b519-aab263478f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:53 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Volume volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e (38e0d690-df5e-4d24-b975-4fcaa5c0028e): created successfully Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29757c15-3ba3-43eb-b519-aab263478f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (98d86782-b39e-431f-93f6-8132023e2ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:53 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1a930d59-514e-4060-bc0c-e5da87eebaaf tempest-CreateVolumesFromImageTest-452738226 None] Created volume successfully. Apr 28 15:15:54 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d 1073741824" returned: 0 in 0.956s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:54 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d Apr 28 15:15:54 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:55 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d" returned: 0 in 1.064s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.516s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438133623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031d8b42-b4a2-40b3-a789-391424ba1daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4110e4faaa4a59bcb52b6367238c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:46Z,use_quota=True,user_id='dbb98b811451435fb97f6023587a279c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Creating volume 031d8b42-b4a2-40b3-a789-391424ba1daf {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:55 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd050052-02e6-4ae4-b925-54858afeeb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93291bf4-ebed-44ff-bdc5-267e16d7782d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e52599-20e5-480f-a153-ebca7530e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:55 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf 1073741824 Apr 28 15:15:55 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:55 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Volume volume-93291bf4-ebed-44ff-bdc5-267e16d7782d (93291bf4-ebed-44ff-bdc5-267e16d7782d): created successfully Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e52599-20e5-480f-a153-ebca7530e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (4e848b6a-0838-4373-9355-f172401bac70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5736ca7c-ad6b-4d1a-b59e-cc430fc0166a tempest-CreateVolumesFromImageTest-452738226 None] Created volume successfully. Apr 28 15:15:56 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf 1073741824" returned: 0 in 1.075s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:56 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf Apr 28 15:15:56 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:57 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf" returned: 0 in 0.884s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.336s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993701180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29da10b9-a18b-47ce-b6e1-b2e384ffa172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9779f81b40474ddfa0fd81d1c86ee459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:15:52Z,use_quota=True,user_id='692a7ede836a475e90288602594b94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Creating volume 29da10b9-a18b-47ce-b6e1-b2e384ffa172 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:15:57 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05171df1-1174-459b-9c3f-9fa14621ca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031d8b42-b4a2-40b3-a789-391424ba1daf', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:57 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 1073741824 Apr 28 15:15:57 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9fddae-d1a3-4ac2-a879-30422ef33893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:57 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Volume volume-031d8b42-b4a2-40b3-a789-391424ba1daf (031d8b42-b4a2-40b3-a789-391424ba1daf): created successfully Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9fddae-d1a3-4ac2-a879-30422ef33893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Flow 'volume_create_manager' (366d092a-92ae-4569-988b-2ffe6ed32947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:57 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-68c42ee4-8096-4c26-a1fa-a4db4431d259 tempest-CreateVolumesFromImageTest-452738226 None] Created volume successfully. Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-031d8b42-b4a2-40b3-a789-391424ba1daf-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-031d8b42-b4a2-40b3-a789-391424ba1daf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-quobyte-031d8b42-b4a2-40b3-a789-391424ba1daf" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-031d8b42-b4a2-40b3-a789-391424ba1daf" acquired by "delete_volume" :: waited 0.040s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[916838dc-34d8-4efe-9b3e-9e2002e1d6f1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:58 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:58 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf Apr 28 15:15:58 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 1073741824" returned: 0 in 1.306s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:58 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 Apr 28 15:15:58 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:59 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf" returned: 0 in 1.331s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:15:59 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf Apr 28 15:15:59 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:15:59 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172" returned: 0 in 1.178s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] <== create_volume: return (2565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.571s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1946aa-7677-492b-852d-61f169a8639d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfee2d91-ef5d-4fbc-ae88-f7b7326d06f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:15:59 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Volume volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 (29da10b9-a18b-47ce-b6e1-b2e384ffa172): created successfully Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfee2d91-ef5d-4fbc-ae88-f7b7326d06f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:15:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Flow 'volume_create_manager' (370418b3-6681-4d0a-894e-b6c296a1d235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:15:59 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-66d5afc8-8c3d-47b7-8255-aad6fe05dcaa tempest-ServersNegativeTestJSON-1076230715 None] Created volume successfully. Apr 28 15:16:00 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-031d8b42-b4a2-40b3-a789-391424ba1daf" returned: 0 in 0.851s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-031d8b42-b4a2-40b3-a789-391424ba1daf" released by "delete_volume" :: held 2.249s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Created reservations ['09e2ca43-d683-4217-8cbe-b599b29f902f', 'd562a396-9a21-445f-815e-0d6b55dc033b', '07ea7f8b-3fc0-4971-b7d1-828db6460fc4', 'd3beeab6-ad30-4172-8264-460dba0c5018'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:00 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:00 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "cinder-29da10b9-a18b-47ce-b6e1-b2e384ffa172-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-29da10b9-a18b-47ce-b6e1-b2e384ffa172-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:01 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.933s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-93291bf4-ebed-44ff-bdc5-267e16d7782d-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Deleted volume successfully. Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-93291bf4-ebed-44ff-bdc5-267e16d7782d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-586edce1-4f77-446a-a586-9c2dad440086 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-031d8b42-b4a2-40b3-a789-391424ba1daf-delete_volume" released by "delete_volume" :: held 3.574s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "cinder-quobyte-29da10b9-a18b-47ce-b6e1-b2e384ffa172" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-quobyte-93291bf4-ebed-44ff-bdc5-267e16d7782d" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-quobyte-29da10b9-a18b-47ce-b6e1-b2e384ffa172" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-93291bf4-ebed-44ff-bdc5-267e16d7782d" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891775f-ffeb-4e2c-a383-8d3fa834a617]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195008a-d07e-4a3c-893d-7b03e939c94d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:02 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 Apr 28 15:16:02 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:02 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d Apr 28 15:16:02 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:03 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d" returned: 0 in 1.117s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:03 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d Apr 28 15:16:03 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:03 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172" returned: 0 in 1.203s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:03 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172 Apr 28 15:16:03 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:03 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-93291bf4-ebed-44ff-bdc5-267e16d7782d" returned: 0 in 0.728s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-93291bf4-ebed-44ff-bdc5-267e16d7782d" released by "delete_volume" :: held 1.927s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:03 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Created reservations ['ae92206a-1f43-4e25-afa1-5c150adb1b1b', 'b1dc97fb-eef8-4422-886d-7c76a1ca0e53', '157a8d7c-4315-474b-81e8-d7eb8b7ae994', '1d2f0e6b-6555-4996-99ef-a0a7f105f84b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:04 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-29da10b9-a18b-47ce-b6e1-b2e384ffa172" returned: 0 in 0.945s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-quobyte-29da10b9-a18b-47ce-b6e1-b2e384ffa172" released by "delete_volume" :: held 2.222s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-38e0d690-df5e-4d24-b975-4fcaa5c0028e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:04 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:04 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-38e0d690-df5e-4d24-b975-4fcaa5c0028e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Created reservations ['fcce231d-1cf2-48ba-a884-23cf00860cdd', '7709691a-b30f-47d9-aa3e-47905f00f8dd', '3abe288f-7c8e-46fe-b499-54ec7e389bc1', '6ff032c1-830a-465b-b2bb-4c9a3f9250b6'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-quobyte-38e0d690-df5e-4d24-b975-4fcaa5c0028e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-38e0d690-df5e-4d24-b975-4fcaa5c0028e" acquired by "delete_volume" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[698c2a9a-8cdc-4518-988d-67ec6488fed3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:04 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:04 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:04 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e Apr 28 15:16:04 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:05 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.903s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Deleted volume successfully. Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e1eff5a2-b71b-4dd1-806d-f5c33d32816b tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-93291bf4-ebed-44ff-bdc5-267e16d7782d-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "cinder-7a4e6395-2537-48e2-b98b-a14b694a543d-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:05 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.865s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Deleted volume successfully. Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-7a4e6395-2537-48e2-b98b-a14b694a543d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c4bfcce2-0dbc-4e9a-b7b4-391eca2c24ed tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-29da10b9-a18b-47ce-b6e1-b2e384ffa172-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "cinder-quobyte-7a4e6395-2537-48e2-b98b-a14b694a543d" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:05 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e" returned: 0 in 1.017s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-quobyte-7a4e6395-2537-48e2-b98b-a14b694a543d" acquired by "delete_volume" :: waited 0.058s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:05 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e Apr 28 15:16:05 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020b87d-4657-4178-b6f7-2b6d97a7fd7b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:05 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d Apr 28 15:16:05 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:06 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-38e0d690-df5e-4d24-b975-4fcaa5c0028e" returned: 0 in 0.726s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-38e0d690-df5e-4d24-b975-4fcaa5c0028e" released by "delete_volume" :: held 1.802s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Created reservations ['f2f80474-e2e0-4248-a1cf-fbfeeb5ae0e5', '1956ae31-fec5-4056-bb4a-5ec2d8a1a8bd', '6ea36908-686c-476b-aad3-748ee3ad5a2a', '4c95ec64-657b-486c-b0e7-7e47b9c6ea28'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:06 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d" returned: 0 in 0.829s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:06 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:06 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:06 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d Apr 28 15:16:06 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-e0115022-d533-471a-a5c1-f3fcf333ef3e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-e0115022-d533-471a-a5c1-f3fcf333ef3e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-quobyte-e0115022-d533-471a-a5c1-f3fcf333ef3e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-e0115022-d533-471a-a5c1-f3fcf333ef3e" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef9655-fd00-411a-9e0b-90e5936ded3a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:06 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e Apr 28 15:16:06 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:07 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7a4e6395-2537-48e2-b98b-a14b694a543d" returned: 0 in 0.869s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:07 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-quobyte-7a4e6395-2537-48e2-b98b-a14b694a543d" released by "delete_volume" :: held 1.767s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.937s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Deleted volume successfully. Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e61a768a-fe8f-4b2b-bd09-fe6461efac94 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-38e0d690-df5e-4d24-b975-4fcaa5c0028e-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Created reservations ['927f457c-140f-4bf6-b0a2-449db5eb63d2', '554fb44e-75aa-48ad-a707-41b29c279c1e', '36aa0615-2e3e-44a6-97b6-1c3e22f3777a', '2297234f-894b-4d0a-9f50-264281f52dae'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:07 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:07 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:07 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e" returned: 0 in 1.077s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:07 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e Apr 28 15:16:07 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.867s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:08 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Deleted volume successfully. Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f0c650ef-f4d7-42b2-9aba-701c6f7943c2 tempest-ServersNegativeTestJSON-1076230715 None] Lock "cinder-7a4e6395-2537-48e2-b98b-a14b694a543d-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:08 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e0115022-d533-471a-a5c1-f3fcf333ef3e" returned: 0 in 0.756s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-e0115022-d533-471a-a5c1-f3fcf333ef3e" released by "delete_volume" :: held 1.887s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Created reservations ['75de0389-68c3-45bb-891e-35b7dd3821d5', 'be1ecf68-b6e9-4ce7-9f56-d45cf8a565c9', 'f3ea528c-e933-4b9e-95ba-9ef027c6283c', '7b85a4d1-0ba3-41f1-b457-e843ebc07d49'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:08 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:08 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-56c9ea89-235c-40e1-8314-0c6773ab218b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-56c9ea89-235c-40e1-8314-0c6773ab218b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "cinder-quobyte-56c9ea89-235c-40e1-8314-0c6773ab218b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-56c9ea89-235c-40e1-8314-0c6773ab218b" acquired by "delete_volume" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4ef86-356d-4a8c-9e67-daed70eb3f55]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:09 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b Apr 28 15:16:09 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:09 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.066s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:09 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Deleted volume successfully. Apr 28 15:16:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c219ed34-d8c3-4944-b140-c49e99fcbd10 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-e0115022-d533-471a-a5c1-f3fcf333ef3e-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:10 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b" returned: 0 in 1.305s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:10 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b Apr 28 15:16:10 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:11 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56c9ea89-235c-40e1-8314-0c6773ab218b" returned: 0 in 1.085s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-quobyte-56c9ea89-235c-40e1-8314-0c6773ab218b" released by "delete_volume" :: held 2.462s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Created reservations ['23690e22-d4b2-4878-9029-1a39cdcf8093', '56b27a62-3acd-468e-bbf2-8ab0e52963a2', '2c13df9b-cacf-4e45-8c10-85d0ee9d3ee6', 'aeb6be7b-fc6d-4260-ac33-52ad43e55832'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:11 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:11 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:12 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.038s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:12 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Deleted volume successfully. Apr 28 15:16:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22da2747-871f-4afc-9c36-ba3618c48da8 tempest-CreateVolumesFromImageTest-452738226 None] Lock "cinder-56c9ea89-235c-40e1-8314-0c6773ab218b-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Flow 'volume_create_manager' (835c4bef-ab3c-4c7a-a253-3cd2e8c15ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f18db57-1b08-48ea-b7b5-28beeb2c869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f18db57-1b08-48ea-b7b5-28beeb2c869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-530042288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372e80a1-aa57-4ad2-a561-045e74bb7304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b5af2dd05437da2e310f1f99b4aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:14Z,use_quota=True,user_id='84796ca906234b0e8f45ea07ed194baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(238dd2b8-8ef3-48e1-b996-249bc78b7bce),volume_type_id=238dd2b8-8ef3-48e1-b996-249bc78b7bce)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43072c5-4140-40c9-800c-f80af1dd3d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43072c5-4140-40c9-800c-f80af1dd3d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e3e829-6922-4996-9243-5a324be364dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e3e829-6922-4996-9243-5a324be364dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372e80a1-aa57-4ad2-a561-045e74bb7304', 'volume_name': 'volume-372e80a1-aa57-4ad2-a561-045e74bb7304', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7647c3-aad0-41da-8f45-3bcdcc8654d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7647c3-aad0-41da-8f45-3bcdcc8654d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69330684-039e-4bd1-a2d2-bd796882beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:14 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Volume 372e80a1-aa57-4ad2-a561-045e74bb7304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372e80a1-aa57-4ad2-a561-045e74bb7304', 'volume_size': 1} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-530042288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372e80a1-aa57-4ad2-a561-045e74bb7304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b5af2dd05437da2e310f1f99b4aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:14Z,use_quota=True,user_id='84796ca906234b0e8f45ea07ed194baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(238dd2b8-8ef3-48e1-b996-249bc78b7bce),volume_type_id=238dd2b8-8ef3-48e1-b996-249bc78b7bce)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Creating volume 372e80a1-aa57-4ad2-a561-045e74bb7304 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:14 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:14 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 1073741824 Apr 28 15:16:14 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:15 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 1073741824" returned: 0 in 1.179s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:15 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 Apr 28 15:16:15 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (94eb92bb-bda7-4a48-bf20-73851a09fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600ecdc9-66bc-45f5-b987-841a9c00147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304" returned: 0 in 1.036s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600ecdc9-66bc-45f5-b987-841a9c00147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439537273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca31d6a-a7c5-4c6f-ac20-f857c4e09397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:17Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797f3ed1-6dd2-4492-9fcd-0b79d81a76c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797f3ed1-6dd2-4492-9fcd-0b79d81a76c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2e0b5f-fb6a-4894-aaff-0f7fe7118f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2e0b5f-fb6a-4894-aaff-0f7fe7118f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca31d6a-a7c5-4c6f-ac20-f857c4e09397', 'volume_name': 'volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70929d6-500e-4eae-bb8b-6224ea6e1c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70929d6-500e-4eae-bb8b-6224ea6e1c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5424f308-cb88-4f53-ad0f-7a95f52c8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume 2ca31d6a-a7c5-4c6f-ac20-f857c4e09397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397', 'volume_size': 1} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439537273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca31d6a-a7c5-4c6f-ac20-f857c4e09397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:17Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume 2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:16 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69330684-039e-4bd1-a2d2-bd796882beb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372e80a1-aa57-4ad2-a561-045e74bb7304', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc587f56-1989-493b-8e58-23f05981392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:16 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 1073741824 Apr 28 15:16:16 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:16 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Volume volume-372e80a1-aa57-4ad2-a561-045e74bb7304 (372e80a1-aa57-4ad2-a561-045e74bb7304): created successfully Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc587f56-1989-493b-8e58-23f05981392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Flow 'volume_create_manager' (835c4bef-ab3c-4c7a-a253-3cd2e8c15ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1fec001c-0585-4cb7-8497-78cd7f0de8b9 tempest-VolumeTypesAccessTest-639173492 None] Created volume successfully. Apr 28 15:16:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Acquiring lock "cinder-372e80a1-aa57-4ad2-a561-045e74bb7304-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "cinder-372e80a1-aa57-4ad2-a561-045e74bb7304-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Acquiring lock "cinder-quobyte-372e80a1-aa57-4ad2-a561-045e74bb7304" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "cinder-quobyte-372e80a1-aa57-4ad2-a561-045e74bb7304" acquired by "delete_volume" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[10001bb8-4f3f-4093-bb80-517d4f82a09c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:18 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 1073741824" returned: 0 in 1.371s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:18 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 Apr 28 15:16:18 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:18 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 Apr 28 15:16:18 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:19 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" returned: 0 in 0.925s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:19 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304" returned: 0 in 1.124s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5424f308-cb88-4f53-ad0f-7a95f52c8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:19 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304 Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c032def-aa52-4690-a772-86766ac6d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:19 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:19 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 (2ca31d6a-a7c5-4c6f-ac20-f857c4e09397): created successfully Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c032def-aa52-4690-a772-86766ac6d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (94eb92bb-bda7-4a48-bf20-73851a09fc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5ee6561e-4ab8-4cb1-90de-7674bcbbb68f tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:20 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-372e80a1-aa57-4ad2-a561-045e74bb7304" returned: 0 in 0.947s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "cinder-quobyte-372e80a1-aa57-4ad2-a561-045e74bb7304" released by "delete_volume" :: held 2.165s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:20 devstack cinder-volume[84270]: WARNING cinder.quota [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2047569220 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2047569220, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:16:20 devstack cinder-volume[84270]: WARNING cinder.quota [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2047569220 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2047569220, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Created reservations ['bd1b24fd-58b7-46d3-b6c0-d3d21f6f5a3b', '283bf25e-ae56-4d36-acf7-9054c9f3774a', '875c8c64-0bd7-4afe-8838-a2f7e9ae2d49', '7b6483b5-d676-439a-a5a4-9b57b2ad9efa'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:20 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:20 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating offline snapshot 6c76d12e-b4a3-4f92-abcb-83374301da07 of volume 2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c9a56-1ed2-4861-a4fe-d81d1e53ee48]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:20 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 Apr 28 15:16:20 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.187s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:21 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:21 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Deleted volume successfully. Apr 28 15:16:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3901fee2-27d9-469c-90a6-22293708dcf9 tempest-VolumeTypesAccessTest-639173492 None] Lock "cinder-372e80a1-aa57-4ad2-a561-045e74bb7304-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:22 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" returned: 0 in 1.237s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:22 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 1G Apr 28 15:16:22 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:23 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 1G" returned: 0 in 1.096s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:23 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 Apr 28 15:16:23 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:24 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07" returned: 0 in 0.922s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:24 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 is being set with open permissions: ugo+rw Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:24 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 Apr 28 15:16:24 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=108,cinder:INSERT=44,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=97,cinder:INSERT=26,cinder:UPDATE=120,cinder:DELETE=10 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:16:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-b405fc31-5d93-4d76-a146-48bc90839077 req-cb0b63fc-2eaf-42f2-b501-395cddfce912 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Terminate volume connection completed successfully. Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-b405fc31-5d93-4d76-a146-48bc90839077 req-cb0b63fc-2eaf-42f2-b501-395cddfce912 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Deleting attachment 58050df6-fc18-489a-8872-90d534c29c5d. {{(pid=84270) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 15:16:24 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07" returned: 0 in 0.726s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:24 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info Apr 28 15:16:24 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "cinder-56b64103-1f64-408f-9b52-e0f42e75f249-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-56b64103-1f64-408f-9b52-e0f42e75f249-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "cinder-quobyte-56b64103-1f64-408f-9b52-e0f42e75f249" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-quobyte-56b64103-1f64-408f-9b52-e0f42e75f249" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f1d0fa-4d4a-4dd7-a7a1-e62403f133a7]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:25 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:16:25 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:25 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info" returned: 0 in 0.888s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:25 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info is being set with open permissions: ugo+rw Apr 28 15:16:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:25 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info Apr 28 15:16:25 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:26 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 1.131s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:26 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.info" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.759s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:26 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:16:26 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cbc6c836-d35e-495a-8453-5734f9cda7e4 tempest-CreateVolumesFromSnapshotTest-992390624 None] Create snapshot completed successfully Apr 28 15:16:27 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 1 in 0.806s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:27 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249 Apr 28 15:16:27 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (d3a584e1-c4d8-40a4-b8e2-62cf4736c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440c9cac-cf26-4eec-8600-712c59b95ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440c9cac-cf26-4eec-8600-712c59b95ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757833497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b384421f-dc01-49a3-b569-379bfc2ecd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:28Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dd7cbb-5bda-4006-a4e5-945bfd8c7006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dd7cbb-5bda-4006-a4e5-945bfd8c7006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b24257-4da8-4bbb-9329-872ea247d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b24257-4da8-4bbb-9329-872ea247d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b384421f-dc01-49a3-b569-379bfc2ecd13', 'volume_name': 'volume-b384421f-dc01-49a3-b569-379bfc2ecd13', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d6478-8ff8-4f70-94dc-283fc81e4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d6478-8ff8-4f70-94dc-283fc81e4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea42cc8d-a815-4d25-8291-41e5d4955ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume b384421f-dc01-49a3-b569-379bfc2ecd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b384421f-dc01-49a3-b569-379bfc2ecd13', 'volume_size': 1} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757833497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b384421f-dc01-49a3-b569-379bfc2ecd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:28Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume b384421f-dc01-49a3-b569-379bfc2ecd13 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:27 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:28 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 1073741824 Apr 28 15:16:28 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:28 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b64103-1f64-408f-9b52-e0f42e75f249" returned: 0 in 1.122s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (ad34c661-3810-430a-a598-578a374f2dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0038de8-8d4a-4435-9c55-76309f600271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-quobyte-56b64103-1f64-408f-9b52-e0f42e75f249" released by "delete_volume" :: held 3.194s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0038de8-8d4a-4435-9c55-76309f600271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15929774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398f38b6-c047-4726-925f-42f1a3dfcb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:28Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488e9036-19ee-482f-8d76-fb51ab8be9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488e9036-19ee-482f-8d76-fb51ab8be9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10364a59-cfb4-49e2-aedc-f0df21d4a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10364a59-cfb4-49e2-aedc-f0df21d4a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398f38b6-c047-4726-925f-42f1a3dfcb55', 'volume_name': 'volume-398f38b6-c047-4726-925f-42f1a3dfcb55', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d233e57f-e31c-4388-8680-4c72be2e3744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d233e57f-e31c-4388-8680-4c72be2e3744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0164d320-3b38-4aa0-a045-937d936b4352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:28 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume 398f38b6-c047-4726-925f-42f1a3dfcb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398f38b6-c047-4726-925f-42f1a3dfcb55', 'volume_size': 1} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.quota [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Created reservations ['1e61cdcf-c923-4a0a-ba98-b9ea2d00edf4', 'cd64c65d-b177-4a66-b8e0-cf5d0faa2caa', 'f6602cfa-184f-44ba-870d-eb201fcadbd8', '625ae23a-cf03-46da-83c4-8dd9b9b7099a'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:28 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:28 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (9aefacb3-46f7-4542-843a-4be59e608ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a97ccf4-4dc1-45f5-a046-2b8d28ba2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a97ccf4-4dc1-45f5-a046-2b8d28ba2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622612045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d97ab7-1e38-4fcd-aef3-242a4ad067b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:29Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81257685-03b2-456e-b939-fb7a29505748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81257685-03b2-456e-b939-fb7a29505748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e01ff8-e652-49ab-b553-f2ade07a23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e01ff8-e652-49ab-b553-f2ade07a23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d97ab7-1e38-4fcd-aef3-242a4ad067b9', 'volume_name': 'volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b84ba1-2484-4aa0-8d00-66674ba063ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b84ba1-2484-4aa0-8d00-66674ba063ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b91f2-22ef-4abe-8892-7c6555166822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume 22d97ab7-1e38-4fcd-aef3-242a4ad067b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9', 'volume_size': 1} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 1073741824" returned: 0 in 1.308s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:29 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 Apr 28 15:16:29 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (2183ab3c-42a0-40ac-8f07-716d459bc44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def8f2c8-0794-4461-8ca7-539d0f35b7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8173d0ea-2f79-498b-9200-27d7ce2419e4 tempest-GroupSnapshotsV319Test-2144159244 None] Group tempest-GroupSnapshotsV319Test-Group-1466661171: creating Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def8f2c8-0794-4461-8ca7-539d0f35b7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1229404115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab79f992-4944-4f04-be5a-e72706fc8eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:30Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109f6741-6c2a-4e64-b565-e0408ab9f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109f6741-6c2a-4e64-b565-e0408ab9f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80df955f-9370-4dfe-b480-ff854160612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80df955f-9370-4dfe-b480-ff854160612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab79f992-4944-4f04-be5a-e72706fc8eab', 'volume_name': 'volume-ab79f992-4944-4f04-be5a-e72706fc8eab', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c57778-7ee3-474e-8c7f-4707dbbe39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c57778-7ee3-474e-8c7f-4707dbbe39ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dab5df-ef96-4f84-ae30-a7d83e2f9384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume ab79f992-4944-4f04-be5a-e72706fc8eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab79f992-4944-4f04-be5a-e72706fc8eab', 'volume_size': 1} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:30 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.250s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.manager [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8173d0ea-2f79-498b-9200-27d7ce2419e4 tempest-GroupSnapshotsV319Test-2144159244 None] Group tempest-GroupSnapshotsV319Test-Group-1466661171: created successfully Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Deleted volume successfully. Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8173d0ea-2f79-498b-9200-27d7ce2419e4 tempest-GroupSnapshotsV319Test-2144159244 None] Create group completed successfully. Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-b405fc31-5d93-4d76-a146-48bc90839077 req-9a79e843-e3ad-4c0b-a0f4-3ccb36bb2258 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-56b64103-1f64-408f-9b52-e0f42e75f249-delete_volume" released by "delete_volume" :: held 5.070s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:30 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13" returned: 0 in 0.833s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15929774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398f38b6-c047-4726-925f-42f1a3dfcb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:28Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume 398f38b6-c047-4726-925f-42f1a3dfcb55 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea42cc8d-a815-4d25-8291-41e5d4955ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b384421f-dc01-49a3-b569-379bfc2ecd13', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250b6627-c998-45b3-a3fd-df561afa2ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 1073741824 Apr 28 15:16:30 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-b384421f-dc01-49a3-b569-379bfc2ecd13 (b384421f-dc01-49a3-b569-379bfc2ecd13): created successfully Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250b6627-c998-45b3-a3fd-df561afa2ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (d3a584e1-c4d8-40a4-b8e2-62cf4736c23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-df9e0056-6533-4c83-a45c-d45c5acd2ad0 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (6c3a9459-4ba3-4563-8300-03de6a602893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53fe58f-b9a8-4b21-a471-32ca585568f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53fe58f-b9a8-4b21-a471-32ca585568f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904611900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898b6c14-0e0a-452f-b2d0-dae2b7fc1610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:30Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8f2226-adef-4574-842d-2921374a89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8f2226-adef-4574-842d-2921374a89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af991dfa-179b-4f08-8ff2-9b2a53757e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af991dfa-179b-4f08-8ff2-9b2a53757e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898b6c14-0e0a-452f-b2d0-dae2b7fc1610', 'volume_name': 'volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508bb0eb-2d83-4c93-8948-34026a6ccab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508bb0eb-2d83-4c93-8948-34026a6ccab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937af2ba-df94-4ec0-ae3e-424d53acbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume 898b6c14-0e0a-452f-b2d0-dae2b7fc1610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610', 'volume_size': 1} Apr 28 15:16:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:31 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Flow 'volume_create_manager' (bf7c03fa-ad32-4658-954e-7041ee2b2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e59428-c455-4976-9deb-c6a55686da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 1073741824" returned: 0 in 1.372s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e59428-c455-4976-9deb-c6a55686da0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814753535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c023c959-16a6-42cf-ad84-a77c9b320e7a,host='devstack@QuobyteHD#QuobyteHD',id=770748a9-57be-4345-af1f-f329d1967b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5329412aada541b2934f5dc5f9da498d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:32Z,use_quota=True,user_id='7d964ac4b8c74aa38be91db64b5b04eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f55f9e26-21eb-4b73-89af-d6b539155028),volume_type_id=f55f9e26-21eb-4b73-89af-d6b539155028)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f065436b-5f8a-4634-9ad5-e762edea5087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f065436b-5f8a-4634-9ad5-e762edea5087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f73d476-5609-4290-8302-d41ec5c0a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f73d476-5609-4290-8302-d41ec5c0a22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770748a9-57be-4345-af1f-f329d1967b64', 'volume_name': 'volume-770748a9-57be-4345-af1f-f329d1967b64', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c679022-dcdd-466c-8c24-e2c9be35705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c679022-dcdd-466c-8c24-e2c9be35705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b38bb-4933-4c0b-a361-22e5a3c7e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:31 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Volume 770748a9-57be-4345-af1f-f329d1967b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770748a9-57be-4345-af1f-f329d1967b64', 'volume_size': 1} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:31 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 Apr 28 15:16:31 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:32 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55" returned: 0 in 0.619s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622612045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d97ab7-1e38-4fcd-aef3-242a4ad067b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:29Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume 22d97ab7-1e38-4fcd-aef3-242a4ad067b9 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:32 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0164d320-3b38-4aa0-a045-937d936b4352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398f38b6-c047-4726-925f-42f1a3dfcb55', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:32 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 1073741824 Apr 28 15:16:32 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7c532e-1f9f-4dbf-a755-21b377c566d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-398f38b6-c047-4726-925f-42f1a3dfcb55 (398f38b6-c047-4726-925f-42f1a3dfcb55): created successfully Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7c532e-1f9f-4dbf-a755-21b377c566d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (ad34c661-3810-430a-a598-578a374f2dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b0620baf-8cf6-4326-8695-c5caeba057c9 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:33 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 1073741824" returned: 0 in 0.918s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:33 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 Apr 28 15:16:33 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:34 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" returned: 0 in 0.851s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.128s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1229404115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab79f992-4944-4f04-be5a-e72706fc8eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:30Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume ab79f992-4944-4f04-be5a-e72706fc8eab {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:34 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b91f2-22ef-4abe-8892-7c6555166822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:34 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab 1073741824 Apr 28 15:16:34 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba7b4a-ddf4-4d1d-93b0-eda17c40dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:34 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 (22d97ab7-1e38-4fcd-aef3-242a4ad067b9): created successfully Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba7b4a-ddf4-4d1d-93b0-eda17c40dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (9aefacb3-46f7-4542-843a-4be59e608ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:34 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7e644161-92f1-481f-8193-8f05b60fec57 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:35 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab 1073741824" returned: 0 in 1.130s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:35 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab Apr 28 15:16:35 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:35 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab" returned: 0 in 0.659s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.209s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904611900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898b6c14-0e0a-452f-b2d0-dae2b7fc1610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7251e866a65641569b77032172f510aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:30Z,use_quota=True,user_id='7c27fdb7f23d4a3ebde2f88dc514b48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Creating volume 898b6c14-0e0a-452f-b2d0-dae2b7fc1610 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:36 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dab5df-ef96-4f84-ae30-a7d83e2f9384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab79f992-4944-4f04-be5a-e72706fc8eab', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d6b320-f1f3-4a07-9c05-5d4ffb1b5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:36 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 1073741824 Apr 28 15:16:36 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:36 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-ab79f992-4944-4f04-be5a-e72706fc8eab (ab79f992-4944-4f04-be5a-e72706fc8eab): created successfully Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d6b320-f1f3-4a07-9c05-5d4ffb1b5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (2183ab3c-42a0-40ac-8f07-716d459bc44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:36 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d4c5cf32-7f92-4c58-9818-4b97bfaf0449 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:37 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 1073741824" returned: 0 in 1.039s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:37 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 Apr 28 15:16:37 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:37 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.203s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c023c959-16a6-42cf-ad84-a77c9b320e7a,created_at=2026-04-28T13:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814753535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c023c959-16a6-42cf-ad84-a77c9b320e7a,host='devstack@QuobyteHD#QuobyteHD',id=770748a9-57be-4345-af1f-f329d1967b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5329412aada541b2934f5dc5f9da498d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:32Z,use_quota=True,user_id='7d964ac4b8c74aa38be91db64b5b04eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f55f9e26-21eb-4b73-89af-d6b539155028),volume_type_id=f55f9e26-21eb-4b73-89af-d6b539155028)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Creating volume 770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:37 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937af2ba-df94-4ec0-ae3e-424d53acbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:38 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 1073741824 Apr 28 15:16:38 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcf988e-bf18-4d79-b380-5fb9f398a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Volume volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 (898b6c14-0e0a-452f-b2d0-dae2b7fc1610): created successfully Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcf988e-bf18-4d79-b380-5fb9f398a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Flow 'volume_create_manager' (6c3a9459-4ba3-4563-8300-03de6a602893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-256f61c2-b459-4e66-abd3-7c913e4dec49 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created volume successfully. Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-898b6c14-0e0a-452f-b2d0-dae2b7fc1610-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-898b6c14-0e0a-452f-b2d0-dae2b7fc1610-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" acquired by "delete_volume" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f317c56f-3563-4b29-8a9a-eb6b38977880]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:39 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 Apr 28 15:16:39 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:39 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 1073741824" returned: 0 in 1.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:39 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 Apr 28 15:16:39 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:40 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" returned: 0 in 1.107s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:40 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610 Apr 28 15:16:40 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:40 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64" returned: 0 in 0.813s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b38bb-4933-4c0b-a361-22e5a3c7e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770748a9-57be-4345-af1f-f329d1967b64', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d79907-b41e-4832-92c2-97df8ef4050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Volume volume-770748a9-57be-4345-af1f-f329d1967b64 (770748a9-57be-4345-af1f-f329d1967b64): created successfully Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d79907-b41e-4832-92c2-97df8ef4050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Flow 'volume_create_manager' (bf7c03fa-ad32-4658-954e-7041ee2b2261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f7e27e57-d640-4e05-bc6b-559e647653a0 tempest-GroupSnapshotsV319Test-2144159244 None] Created volume successfully. Apr 28 15:16:40 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" returned: 0 in 0.718s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-898b6c14-0e0a-452f-b2d0-dae2b7fc1610" released by "delete_volume" :: held 1.919s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['b4e94c5f-a5de-482b-8131-a63fb3cf7b6e', 'b6983830-1293-4fcb-8e05-7f5fe04e28e9', '506e658c-34dd-4a20-97a5-fae2128ba90f', '0019b49a-77df-49da-81fe-4359a9cd8960'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:41 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:41 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-ab79f992-4944-4f04-be5a-e72706fc8eab-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] GroupSnapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: creating. Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-ab79f992-4944-4f04-be5a-e72706fc8eab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Group snapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: creating. {{(pid=84270) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Creating offline snapshot 19ad1e40-aa00-4026-aa13-88f1694152f7 of volume 770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-ab79f992-4944-4f04-be5a-e72706fc8eab" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-ab79f992-4944-4f04-be5a-e72706fc8eab" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08eecbd-5361-433d-8eaa-9bc51db1fca0]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6046a-f945-4f74-bf0a-a64725ef0520]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:41 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab Apr 28 15:16:41 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:41 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 Apr 28 15:16:41 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-fd7d55a8-b788-4601-9e81-64a68b306436 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Terminate volume connection completed successfully. Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-fd7d55a8-b788-4601-9e81-64a68b306436 tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Deleting attachment ce067aeb-422d-4bd1-aeef-92a62a192690. {{(pid=84270) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 15:16:41 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.817s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4a286fb-3167-4243-a671-9b4ccba82405 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-898b6c14-0e0a-452f-b2d0-dae2b7fc1610-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:42 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64" returned: 0 in 0.863s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:42 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 1G Apr 28 15:16:42 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "cinder-56b2b73a-373d-4d82-8895-862b967a1d9e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-56b2b73a-373d-4d82-8895-862b967a1d9e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "cinder-quobyte-56b2b73a-373d-4d82-8895-862b967a1d9e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-quobyte-56b2b73a-373d-4d82-8895-862b967a1d9e" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac805e99-33bf-4269-ae69-e58ff5ac5c35]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:42 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab" returned: 0 in 1.127s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:42 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab Apr 28 15:16:42 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:42 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e Apr 28 15:16:42 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:43 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ab79f992-4944-4f04-be5a-e72706fc8eab" returned: 0 in 0.988s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:43 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e" returned: 0 in 1.023s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-ab79f992-4944-4f04-be5a-e72706fc8eab" released by "delete_volume" :: held 2.199s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:43 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e Apr 28 15:16:43 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:43 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 1G" returned: 0 in 1.336s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770748a9-57be-4345-af1f-f329d1967b64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:43 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770748a9-57be-4345-af1f-f329d1967b64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 Apr 28 15:16:43 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['a3c9485f-db30-484a-bc5f-a0be50364e40', '1e1f1397-5751-4412-a23d-7b2637f1389d', 'db4a2725-9b85-4c4f-8bfe-9f13fb516ab3', 'd7771c45-c52b-486f-96a1-9ef38e2eafa3'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:43 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:43 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:44 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56b2b73a-373d-4d82-8895-862b967a1d9e" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-quobyte-56b2b73a-373d-4d82-8895-862b967a1d9e" released by "delete_volume" :: held 1.807s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.quota [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Created reservations ['193ba22a-1917-4ef9-a2c8-2fffb9efd699', '732ebb4a-3e1f-4a68-a208-0c95503cc177', 'efa99028-7a7c-4409-b47b-90b3f23682e1', 'cb2294ea-156f-46ba-aaee-99a6cb6432f0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:44 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:44 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:44 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770748a9-57be-4345-af1f-f329d1967b64 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7" returned: 0 in 0.925s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:44 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:44 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 Apr 28 15:16:44 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:44 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.806s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-22d97ab7-1e38-4fcd-aef3-242a4ad067b9-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7c333b8b-55b2-4b2d-8d8e-b6e6460d31bb tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-ab79f992-4944-4f04-be5a-e72706fc8eab-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-22d97ab7-1e38-4fcd-aef3-242a4ad067b9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[0976d1aa-7550-4582-9035-941a0403dc76]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:44 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 Apr 28 15:16:44 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:45 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7" returned: 0 in 0.886s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:45 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.960s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG cinder.manager [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:45 devstack cinder-volume[84270]: INFO cinder.volume.manager [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Deleted volume successfully. Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [req-c102a82e-803d-4bc1-99df-c467cd61a139 req-4f6ed791-f964-4f16-9fe5-dee5028db53a tempest-ServerBootFromVolumeStableRescueTest-471103356 None] Lock "cinder-56b2b73a-373d-4d82-8895-862b967a1d9e-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:45 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info Apr 28 15:16:45 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:45 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" returned: 0 in 0.896s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:45 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9 Apr 28 15:16:45 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:46 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info" returned: 0 in 0.713s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:46 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:46 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info Apr 28 15:16:46 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (eebf7b51-7cd2-4723-ba1f-cf82d2b5cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96285e9-c482-404a-9f84-490da327f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96285e9-c482-404a-9f84-490da327f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-861420006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:46Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eb1366-a75d-44b2-a1ab-5007c36946f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eb1366-a75d-44b2-a1ab-5007c36946f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e911c666-1c49-4901-8263-e333a5b8cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e911c666-1c49-4901-8263-e333a5b8cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933', 'volume_name': 'volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639dfa05-4cc1-4927-bf2e-fffc09da8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639dfa05-4cc1-4927-bf2e-fffc09da8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c382c3-3c1e-4079-b76f-8bee13f9f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:46 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Volume c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933', 'volume_size': 1} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:46 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-22d97ab7-1e38-4fcd-aef3-242a4ad067b9" released by "delete_volume" :: held 1.715s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['4075f1fa-c9f8-4e72-a14e-446aa571f323', 'b1da19db-9efd-4ea0-98b1-d0ecd4da0520', '119986ab-9aec-4a94-af26-eab3592b1cc1', '9c133a5c-5a46-4ec6-8e38-fbf6641b5dfc'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:46 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:46 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:46 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.info" returned: 0 in 0.697s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.578s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-861420006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:46Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Creating volume c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:46 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:46 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 1073741824 Apr 28 15:16:46 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8246a051-1430-44d4-a810-6e0810551b74 tempest-GroupSnapshotsV319Test-2144159244 None] group_snapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: created successfully Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-398f38b6-c047-4726-925f-42f1a3dfcb55-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-398f38b6-c047-4726-925f-42f1a3dfcb55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-398f38b6-c047-4726-925f-42f1a3dfcb55" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-398f38b6-c047-4726-925f-42f1a3dfcb55" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f14a97-e9d5-4d19-bb33-b933587d2bf1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:47 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 Apr 28 15:16:47 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:47 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.685s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:47 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8e625f8-cb4d-4f5f-b597-1334a587d71c tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-22d97ab7-1e38-4fcd-aef3-242a4ad067b9-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:47 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 1073741824" returned: 0 in 1.063s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:47 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 Apr 28 15:16:47 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] group_snapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: deleting Apr 28 15:16:48 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55" returned: 0 in 1.222s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] group_snapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: deleting {{(pid=84270) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 15:16:48 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55 Apr 28 15:16:48 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "cinder-quobyte-19ad1e40-aa00-4026-aa13-88f1694152f7" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-19ad1e40-aa00-4026-aa13-88f1694152f7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Deleting offline snapshot 19ad1e40-aa00-4026-aa13-88f1694152f7 of volume 770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] snapshot_file for this snap is: volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85904b0-1369-41a3-9ef6-de2f48384d32]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:48 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 Apr 28 15:16:48 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:48 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" returned: 0 in 0.833s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c382c3-3c1e-4079-b76f-8bee13f9f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b1f5e-7b66-44dc-9341-6151633516c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:48 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Volume volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 (c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933): created successfully Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b1f5e-7b66-44dc-9341-6151633516c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (eebf7b51-7cd2-4723-ba1f-cf82d2b5cae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-671da8fd-cd1f-4d0d-9cfb-5a20807544e8 tempest-VolumesListAdminTestJSON-1539724094 None] Created volume successfully. Apr 28 15:16:48 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-398f38b6-c047-4726-925f-42f1a3dfcb55" returned: 0 in 0.682s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-398f38b6-c047-4726-925f-42f1a3dfcb55" released by "delete_volume" :: held 1.967s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['5c3aa0ba-7d94-400c-bd44-2f0db2843777', '89bd7418-c3be-4910-9aad-28bcc6d2b47f', 'ca402931-c7ad-43cd-9660-969dc282c620', 'd1015d3f-6aad-448f-8c27-8a06b0306269'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:49 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:49 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:49 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7" returned: 0 in 0.866s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770748a9-57be-4345-af1f-f329d1967b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-b384421f-dc01-49a3-b569-379bfc2ecd13-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4b564-1c63-491a-acaf-5326c73935fa]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-b384421f-dc01-49a3-b569-379bfc2ecd13-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-b384421f-dc01-49a3-b569-379bfc2ecd13" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-b384421f-dc01-49a3-b569-379bfc2ecd13" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:49 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[caff57b2-8473-479e-9d1f-716d3a7a8b2c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:49 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:49 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 Apr 28 15:16:49 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:50 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.924s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (4abe82f9-da95-4f63-8101-6ee268a162b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956cab8-472c-4d7e-9b1f-d96fcc51fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ba328c51-adbe-4bf3-8721-e49d7f0a0a83 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-398f38b6-c047-4726-925f-42f1a3dfcb55-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956cab8-472c-4d7e-9b1f-d96fcc51fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1896820287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d907c5-b785-4a3d-ae8a-792d359c35f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:50Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8433751c-5859-4205-b6df-fd3478e6c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8433751c-5859-4205-b6df-fd3478e6c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721db35d-ec52-4adb-8579-05bc39f2db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721db35d-ec52-4adb-8579-05bc39f2db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d907c5-b785-4a3d-ae8a-792d359c35f7', 'volume_name': 'volume-16d907c5-b785-4a3d-ae8a-792d359c35f7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aa55b5-a38e-4724-9ff9-413a7e8fc799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aa55b5-a38e-4724-9ff9-413a7e8fc799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7aab98-0723-4696-87b9-536299156d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Volume 16d907c5-b785-4a3d-ae8a-792d359c35f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d907c5-b785-4a3d-ae8a-792d359c35f7', 'volume_size': 1} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1896820287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d907c5-b785-4a3d-ae8a-792d359c35f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:50Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Creating volume 16d907c5-b785-4a3d-ae8a-792d359c35f7 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:50 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:50 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 1073741824 Apr 28 15:16:50 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:50 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64" returned: 0 in 0.941s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:50 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 Apr 28 15:16:50 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:50 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13" returned: 0 in 0.872s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:50 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:50 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:50 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13 Apr 28 15:16:50 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:51 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7" returned: 0 in 0.839s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:51 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7 Apr 28 15:16:51 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:51 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 1073741824" returned: 0 in 1.039s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:51 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.808s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:51 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 Apr 28 15:16:51 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:51 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b384421f-dc01-49a3-b569-379bfc2ecd13" returned: 0 in 0.849s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-b384421f-dc01-49a3-b569-379bfc2ecd13" released by "delete_volume" :: held 1.786s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['5ec4cbc1-c75c-4d91-a01f-8332c8a74598', 'fd565e76-a99f-42f1-ab7d-cccb6fbee3e6', 'bbfff902-fb48-4a29-995a-a99c7c4cb0f5', '4853b547-3b77-48f3-85df-0e828b8383c8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:51 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:51 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-6c76d12e-b4a3-4f92-abcb-83374301da07-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-6c76d12e-b4a3-4f92-abcb-83374301da07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-6c76d12e-b4a3-4f92-abcb-83374301da07" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-6c76d12e-b4a3-4f92-abcb-83374301da07" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:51 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleting offline snapshot 6c76d12e-b4a3-4f92-abcb-83374301da07 of volume 2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:16:51 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] snapshot_file for this snap is: volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64.19ad1e40-aa00-4026-aa13-88f1694152f7" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0ab86-e6c5-4cab-af6b-81a655146238]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7aab98-0723-4696-87b9-536299156d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d907c5-b785-4a3d-ae8a-792d359c35f7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2ae184-8512-4f74-9a64-395c32db6b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-19ad1e40-aa00-4026-aa13-88f1694152f7" released by "_delete_snapshot" :: held 3.640s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Volume volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 (16d907c5-b785-4a3d-ae8a-792d359c35f7): created successfully Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2ae184-8512-4f74-9a64-395c32db6b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (4abe82f9-da95-4f63-8101-6ee268a162b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" released by "delete_snapshot" :: held 3.711s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-53e0c1fb-90de-4f46-b7b4-a9003b46a094 tempest-VolumesListAdminTestJSON-1539724094 None] Created volume successfully. Apr 28 15:16:52 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 Apr 28 15:16:52 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:52 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.724s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:52 devstack cinder-volume[84270]: WARNING cinder.quota [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-874056567 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-874056567, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:16:52 devstack cinder-volume[84270]: WARNING cinder.quota [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-874056567 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-874056567, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] Created reservations ['00756929-5277-4a21-9601-1d522827b31c', 'a54a18ae-9ef3-49cd-8296-2ace9c858e5a', 'caf41d87-6fce-4caa-b676-ea50b03b890d', 'f6a86cdf-ae5a-4299-b99b-f5ed232e39a6'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d89aca8e-b831-41af-ad54-e4919457fee6 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-b384421f-dc01-49a3-b569-379bfc2ecd13-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-67961ed9-d496-44b5-88f2-49c7d068d7e9 tempest-GroupSnapshotsV319Test-2144159244 None] group_snapshot adefc5c6-1785-452c-97bc-e4e0ed079cc2: deleted successfully Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (b9efe342-66b3-4f63-8055-ad26fa7cf188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ac9b0-d5ed-4500-b510-48d80c981f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ac9b0-d5ed-4500-b510-48d80c981f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-456803242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:53Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937e0ec-51a7-4bf9-9d0e-9b5b14379b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937e0ec-51a7-4bf9-9d0e-9b5b14379b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cb38c3-910e-4f29-9dc7-d9825ec7ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cb38c3-910e-4f29-9dc7-d9825ec7ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1', 'volume_name': 'volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6521ca-e254-4d32-af73-39d04f587f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6521ca-e254-4d32-af73-39d04f587f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0266934-c044-41bf-97ff-cc8b485d373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Volume 2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1', 'volume_size': 1} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-456803242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a015faed53544825810ef9614f8a174e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:53Z,use_quota=True,user_id='557fb4a375fd4e1ba90fe390f8b7f6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Creating volume 2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:52 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07" returned: 0 in 0.819s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:16:52 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 1073741824 Apr 28 15:16:52 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ef03d-a141-4288-a415-6d7daf39e748]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:52 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 Apr 28 15:16:52 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" acquired by "delete_volume" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[add5df61-ae6c-4a08-8de6-255e4fedca65]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:53 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 Apr 28 15:16:53 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:53 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 1073741824" returned: 0 in 0.888s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:53 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" returned: 0 in 0.861s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:53 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 Apr 28 15:16:53 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:53 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 Apr 28 15:16:53 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:53 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64" returned: 0 in 0.863s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:53 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64 Apr 28 15:16:53 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:54 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" returned: 0 in 0.792s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0266934-c044-41bf-97ff-cc8b485d373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097da8ef-22a4-4928-84e8-62a225da33b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:54 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Volume volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 (2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1): created successfully Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097da8ef-22a4-4928-84e8-62a225da33b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Flow 'volume_create_manager' (b9efe342-66b3-4f63-8055-ad26fa7cf188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:54 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:54 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4b2898e9-fee3-4b59-b251-cb0263dfc410 tempest-VolumesListAdminTestJSON-1539724094 None] Created volume successfully. Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07" returned: 0 in 0.939s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:54 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-770748a9-57be-4345-af1f-f329d1967b64" returned: 0 in 0.732s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:54 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07 Apr 28 15:16:54 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "cinder-quobyte-770748a9-57be-4345-af1f-f329d1967b64" released by "delete_volume" :: held 1.669s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Created reservations ['2647d0dd-fb64-46f7-ba47-8cdd2a7a6fa8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:54 devstack cinder-volume[84270]: WARNING cinder.quota [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-874056567 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-874056567, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Created reservations ['4ee35adf-6a15-47a0-9f3d-9707161918b8', '0e66431f-8c8d-4747-aba6-7290a929d53c', '554d1535-7182-48e7-bb71-2c6512daca72', 'f3865e15-79e2-442d-9efa-cb4e786b7101'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:55 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:55 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:55 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397.6c76d12e-b4a3-4f92-abcb-83374301da07" returned: 0 in 0.810s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-6c76d12e-b4a3-4f92-abcb-83374301da07" released by "_delete_snapshot" :: held 3.643s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" released by "delete_snapshot" :: held 3.707s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['c1c3ff88-155d-4d32-9613-a1501e9cd336', '5e16f73b-1096-43aa-ab45-fb33a4c3ac8d', '313a7c2e-ce9e-4802-a38c-2594a449e79f', '936b6695-c36f-4ff0-a33a-fe4a595b754d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:16:55 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Flow 'volume_create_manager' (dcf019d4-e8f8-4ceb-9c9f-c3bfed47d382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edffd64d-6188-496b-9951-9ce223b41494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.917s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cc5ee7ee-4a8c-4a01-b64c-1ec4f633b279 tempest-GroupSnapshotsV319Test-2144159244 None] Delete group completed successfully. Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edffd64d-6188-496b-9951-9ce223b41494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae2965e-d26b-47c8-91f3-e3fe713bc666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed5657b5f0e4765a88824246d1756d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:56Z,use_quota=True,user_id='9a88f4d6dc9c4b1e95911e4899bac1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c948c5-dfb1-4f94-a8ee-9d64f5522e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c948c5-dfb1-4f94-a8ee-9d64f5522e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92c4064-2980-44b7-9a82-5eaba62a9199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92c4064-2980-44b7-9a82-5eaba62a9199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae2965e-d26b-47c8-91f3-e3fe713bc666', 'volume_name': 'volume-cae2965e-d26b-47c8-91f3-e3fe713bc666', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be62ce6-3847-48c1-9430-2a14a7e0da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be62ce6-3847-48c1-9430-2a14a7e0da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30aacb94-f2c7-4835-8cd9-b6a2525b1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:55 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Volume cae2965e-d26b-47c8-91f3-e3fe713bc666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae2965e-d26b-47c8-91f3-e3fe713bc666', 'volume_size': 1} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae2965e-d26b-47c8-91f3-e3fe713bc666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed5657b5f0e4765a88824246d1756d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:16:56Z,use_quota=True,user_id='9a88f4d6dc9c4b1e95911e4899bac1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Creating volume cae2965e-d26b-47c8-91f3-e3fe713bc666 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:16:56 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Delete snapshot completed successfully. Apr 28 15:16:56 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 1073741824 Apr 28 15:16:56 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-98dfa594-d722-4fc0-b8a1-b8d5fc917a85 tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-6c76d12e-b4a3-4f92-abcb-83374301da07-delete_snapshot" released by "delete_snapshot" :: held 4.231s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ee94c-2202-4678-bf32-2e8ee6defa1a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:56 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 Apr 28 15:16:56 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:57 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 1073741824" returned: 0 in 1.221s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:57 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 Apr 28 15:16:57 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:57 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" returned: 0 in 1.039s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:57 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397 Apr 28 15:16:57 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:58 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" returned: 0 in 0.715s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-quobyte-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397" released by "delete_volume" :: held 1.887s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:58 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666" returned: 0 in 0.916s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Created reservations ['149ea617-79db-4258-aa7f-ab8ca154d559', 'ed83728f-f341-49fc-a9db-bee54f677529', '06472976-6789-4859-a865-4396e3db3d13', '57d63ddc-31ca-4f4a-96d4-334ec43fd694'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30aacb94-f2c7-4835-8cd9-b6a2525b1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae2965e-d26b-47c8-91f3-e3fe713bc666', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b830d-615f-4ebc-adc6-63982430c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:16:58 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Volume volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 (cae2965e-d26b-47c8-91f3-e3fe713bc666): created successfully Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b830d-615f-4ebc-adc6-63982430c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Flow 'volume_create_manager' (dcf019d4-e8f8-4ceb-9c9f-c3bfed47d382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:16:58 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-28d8b38c-d7a7-4802-abf9-63e71ddd2e4b tempest-VolumesListAdminTestJSON-466978438 None] Created volume successfully. Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:16:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:58 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:16:58 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Acquiring lock "cinder-cae2965e-d26b-47c8-91f3-e3fe713bc666-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "cinder-cae2965e-d26b-47c8-91f3-e3fe713bc666-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:59 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.888s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:16:59 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Deleted volume successfully. Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1adca1bd-1a4d-4f03-8026-160b336ee5ee tempest-CreateVolumesFromSnapshotTest-992390624 None] Lock "cinder-2ca31d6a-a7c5-4c6f-ac20-f857c4e09397-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Acquiring lock "cinder-quobyte-cae2965e-d26b-47c8-91f3-e3fe713bc666" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "cinder-quobyte-cae2965e-d26b-47c8-91f3-e3fe713bc666" acquired by "delete_volume" :: waited 0.064s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a848f17-65ce-4f04-9201-d7dd5b48533e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-quobyte-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e56358-5987-4fc0-aaea-f8f99707ed28]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:16:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:16:59 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 Apr 28 15:16:59 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:16:59 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 Apr 28 15:16:59 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:00 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666" returned: 0 in 1.086s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:00 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666 Apr 28 15:17:00 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:00 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" returned: 0 in 1.058s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:00 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1 Apr 28 15:17:00 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:01 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" returned: 0 in 0.839s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1" released by "delete_volume" :: held 1.985s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Created reservations ['f17809fa-09d8-4e67-9259-6bb450800943', '7de6f715-b38e-4456-ac32-89e34014a6db', '4f74cdc0-3b43-4588-bcf1-92035479380d', '47e0360c-820c-4452-9f72-3ba2ce319058'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:01 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cae2965e-d26b-47c8-91f3-e3fe713bc666" returned: 0 in 1.059s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "cinder-quobyte-cae2965e-d26b-47c8-91f3-e3fe713bc666" released by "delete_volume" :: held 2.226s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Created reservations ['5c8c479e-c9e5-4c6d-8769-64fd54f09e7e', '610f2266-d2f9-4396-beab-0e4d9c864d7c', 'f5da68f2-6020-4567-beb6-8cc7efbd8893', 'ab296421-f121-4e0f-af41-3ff806dfbe06'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:01 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:01 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:01 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:01 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-16d907c5-b785-4a3d-ae8a-792d359c35f7-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-16d907c5-b785-4a3d-ae8a-792d359c35f7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-quobyte-16d907c5-b785-4a3d-ae8a-792d359c35f7" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-16d907c5-b785-4a3d-ae8a-792d359c35f7" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f5d0fe-895c-47cb-9fb2-6e3f49ecf719]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:02 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 Apr 28 15:17:02 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:02 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.811s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:02 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Deleted volume successfully. Apr 28 15:17:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ac434215-1d3f-4c62-8555-0379c84973c1 tempest-VolumesListAdminTestJSON-466978438 None] Lock "cinder-cae2965e-d26b-47c8-91f3-e3fe713bc666-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:03 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.373s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:03 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Deleted volume successfully. Apr 28 15:17:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c2538a7e-c658-4fe0-9deb-7c12c4d1ab0a tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-2d17c4c3-9d3a-4a8b-93a6-9e67ba563db1-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:03 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7" returned: 0 in 1.324s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:03 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7 Apr 28 15:17:03 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:04 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-16d907c5-b785-4a3d-ae8a-792d359c35f7" returned: 0 in 0.808s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-27fe6202-b4e7-49e0-b3a1-740dc493e3ba tempest-GroupsTest-1201381388 None] Group tempest-Group1-1313437933: creating Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-16d907c5-b785-4a3d-ae8a-792d359c35f7" released by "delete_volume" :: held 2.230s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-27fe6202-b4e7-49e0-b3a1-740dc493e3ba tempest-GroupsTest-1201381388 None] Group tempest-Group1-1313437933: created successfully Apr 28 15:17:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-27fe6202-b4e7-49e0-b3a1-740dc493e3ba tempest-GroupsTest-1201381388 None] Create group completed successfully. Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Created reservations ['13118b2b-5a80-4864-a142-4046b1094701', '0030a3dd-5fcf-428c-8a8c-c356a297c143', '3b1056b7-3272-451e-b83c-f180aec31933', 'c5349209-bd32-4ee2-a4bf-cfc109639741'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:04 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:04 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:05 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.680s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Deleted volume successfully. Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d814078-a88b-4bd2-8390-ed34a6e8c41c tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-16d907c5-b785-4a3d-ae8a-792d359c35f7-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3ed0aeba-758a-4cdb-8942-f6910ce3158d tempest-GroupsTest-1201381388 None] Group tempest-Group2-1187564058: creating Apr 28 15:17:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3ed0aeba-758a-4cdb-8942-f6910ce3158d tempest-GroupsTest-1201381388 None] Group tempest-Group2-1187564058: created successfully Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "cinder-quobyte-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3ed0aeba-758a-4cdb-8942-f6910ce3158d tempest-GroupsTest-1201381388 None] Create group completed successfully. Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f89499-bef5-4e9b-aa14-53af73ee4637]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:05 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 Apr 28 15:17:05 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:06 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" returned: 0 in 0.791s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:06 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933 Apr 28 15:17:06 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:07 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" returned: 0 in 0.805s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-quobyte-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933" released by "delete_volume" :: held 1.683s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (fc58b6c7-b81e-49c9-abb2-5f4c4023a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52fae4-526e-4624-94ca-2e0465a3cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52fae4-526e-4624-94ca-2e0465a3cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644617346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db4f59c8-9337-4d87-b2e5-9f737b81fcaf,host='devstack@QuobyteHD#QuobyteHD',id=abb96258-db42-4084-830c-ddc79e645676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:07Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0d639b-4da4-4849-b4d8-e75998ee4e04),volume_type_id=5d0d639b-4da4-4849-b4d8-e75998ee4e04)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ac99a-1371-44c9-9a64-811ee666183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ac99a-1371-44c9-9a64-811ee666183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540626e-2257-4684-bdbf-4ee3cb6a7ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540626e-2257-4684-bdbf-4ee3cb6a7ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb96258-db42-4084-830c-ddc79e645676', 'volume_name': 'volume-abb96258-db42-4084-830c-ddc79e645676', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63d75f2-27f0-46b8-8a36-d9eb4f0f906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63d75f2-27f0-46b8-8a36-d9eb4f0f906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f96d975-95cd-4032-a317-2c6790ffd728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:07 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Volume abb96258-db42-4084-830c-ddc79e645676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb96258-db42-4084-830c-ddc79e645676', 'volume_size': 1} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db4f59c8-9337-4d87-b2e5-9f737b81fcaf,created_at=2026-04-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644617346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db4f59c8-9337-4d87-b2e5-9f737b81fcaf,host='devstack@QuobyteHD#QuobyteHD',id=abb96258-db42-4084-830c-ddc79e645676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:07Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0d639b-4da4-4849-b4d8-e75998ee4e04),volume_type_id=5d0d639b-4da4-4849-b4d8-e75998ee4e04)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Creating volume abb96258-db42-4084-830c-ddc79e645676 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:07 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:07 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 1073741824 Apr 28 15:17:07 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Created reservations ['31cc6aac-a475-4a1c-939f-480f4b877e92', 'b60d13b4-1b10-4264-b263-c11e96d61f3c', 'fee7e9bf-44bf-4afe-b06d-bcb02f519da4', '5d91a59f-1be2-4469-a617-e4d6cbbce78d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:07 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:07 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:08 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.958s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Deleted volume successfully. Apr 28 15:17:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7548c3f3-2ae7-4559-9ab4-e06f50409152 tempest-VolumesListAdminTestJSON-1539724094 None] Lock "cinder-c4fc6bc9-f2d7-44a9-927b-23a5b2b2d933-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:08 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 1073741824" returned: 0 in 1.300s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:08 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 Apr 28 15:17:08 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:09 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676" returned: 0 in 0.611s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f96d975-95cd-4032-a317-2c6790ffd728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb96258-db42-4084-830c-ddc79e645676', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b826c0d-5b60-41b4-8939-cd667d989cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:09 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Volume volume-abb96258-db42-4084-830c-ddc79e645676 (abb96258-db42-4084-830c-ddc79e645676): created successfully Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b826c0d-5b60-41b4-8939-cd667d989cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:09 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (fc58b6c7-b81e-49c9-abb2-5f4c4023a743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:09 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d3b4cf37-fff7-4188-8d93-beaf7b92e046 tempest-GroupsTest-1201381388 None] Created volume successfully. Apr 28 15:17:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Acquiring lock "cinder-quobyte-abb96258-db42-4084-830c-ddc79e645676" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-abb96258-db42-4084-830c-ddc79e645676" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:10 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[46edf5f7-4db5-48ea-a942-2cd274706b03]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:10 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 Apr 28 15:17:10 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:11 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676" returned: 0 in 0.764s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:11 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676 Apr 28 15:17:11 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:11 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-abb96258-db42-4084-830c-ddc79e645676" returned: 0 in 0.688s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-abb96258-db42-4084-830c-ddc79e645676" released by "delete_volume" :: held 1.526s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Created reservations ['449f3c51-09b6-4873-9b50-3e7e338780eb'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:11 devstack cinder-volume[84270]: WARNING cinder.quota [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1638255424 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1638255424, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:17:11 devstack cinder-volume[84270]: WARNING cinder.quota [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1638255424 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1638255424, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:17:11 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Created reservations ['2d276b8e-2f73-4144-b193-b591a0f8a75a', 'bf91dc8e-94f6-4cdb-add7-b5d92aaa9b60', '224b680e-7c86-4f5a-a7cd-55a6304e58f5', 'ef5ed9e6-42da-4eab-82fa-f766902d30bf'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:12 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:12 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Created reservations ['118f14f2-dab1-41c2-a4d3-df3a3b7af419'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:12 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.793s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:12 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c1c58db1-4937-4641-a8ab-a811c619922d tempest-GroupsTest-1201381388 None] Delete group completed successfully. Apr 28 15:17:12 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:12 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:13 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.620s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:13 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-feddfe72-fc82-4a07-80b3-f77b62d7189c tempest-GroupsTest-1201381388 None] Delete group completed successfully. Apr 28 15:17:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-161c1b20-8915-4aea-ad16-97337a49aad8 tempest-GroupsTest-1201381388 None] Group tempest-GroupsTest-Group-317323945: creating Apr 28 15:17:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-161c1b20-8915-4aea-ad16-97337a49aad8 tempest-GroupsTest-1201381388 None] Group tempest-GroupsTest-Group-317323945: created successfully Apr 28 15:17:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-161c1b20-8915-4aea-ad16-97337a49aad8 tempest-GroupsTest-1201381388 None] Create group completed successfully. Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (496d9d74-0344-4893-8751-69184a83eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcf1f16-faa9-4ccc-bcbb-1df66356bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcf1f16-faa9-4ccc-bcbb-1df66356bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739592982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,host='devstack@QuobyteHD#QuobyteHD',id=df34e7a6-a420-45e9-95cc-d5b3b89e03cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:16Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6034c54f-59fd-4137-82f1-9bebdccf29f6),volume_type_id=6034c54f-59fd-4137-82f1-9bebdccf29f6)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69a945-39d6-4a1b-946b-fc3bc7ccebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69a945-39d6-4a1b-946b-fc3bc7ccebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584e7231-24ec-4340-aeac-7eaca62867b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584e7231-24ec-4340-aeac-7eaca62867b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df34e7a6-a420-45e9-95cc-d5b3b89e03cd', 'volume_name': 'volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2948a744-0084-45f4-bdc8-579b99298e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2948a744-0084-45f4-bdc8-579b99298e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8929f96f-f5fe-4eb3-b280-b21fb6874ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:16 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Volume df34e7a6-a420-45e9-95cc-d5b3b89e03cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd', 'volume_size': 1} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,created_at=2026-04-28T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739592982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,host='devstack@QuobyteHD#QuobyteHD',id=df34e7a6-a420-45e9-95cc-d5b3b89e03cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:16Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6034c54f-59fd-4137-82f1-9bebdccf29f6),volume_type_id=6034c54f-59fd-4137-82f1-9bebdccf29f6)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Creating volume df34e7a6-a420-45e9-95cc-d5b3b89e03cd {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:16 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:16 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd 1073741824 Apr 28 15:17:16 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:17 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd 1073741824" returned: 0 in 0.955s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:17 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd Apr 28 15:17:17 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:18 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" returned: 0 in 0.678s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8929f96f-f5fe-4eb3-b280-b21fb6874ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2631c1-cc16-4914-bd59-d33b12a23cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:18 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Volume volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd (df34e7a6-a420-45e9-95cc-d5b3b89e03cd): created successfully Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2631c1-cc16-4914-bd59-d33b12a23cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (496d9d74-0344-4893-8751-69184a83eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-30c3f875-2a8d-43cd-ba34-f1fe4a016d58 tempest-GroupsTest-1201381388 None] Created volume successfully. Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (331ac32c-41ad-435a-bba1-ccaf99f48afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01d7d7-7f16-4bc4-919c-25435373c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01d7d7-7f16-4bc4-919c-25435373c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159325209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,host='devstack@QuobyteHD#QuobyteHD',id=6b9bafea-2407-4f37-a33b-21ee8efcf79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:19Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6034c54f-59fd-4137-82f1-9bebdccf29f6),volume_type_id=6034c54f-59fd-4137-82f1-9bebdccf29f6)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf2ab72-cef6-4fde-bf54-00316ad27747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf2ab72-cef6-4fde-bf54-00316ad27747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c211e-77bf-48b5-accd-824ec92d6b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c211e-77bf-48b5-accd-824ec92d6b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9bafea-2407-4f37-a33b-21ee8efcf79a', 'volume_name': 'volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c5e07-ddaf-4445-acbe-365c624f6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c5e07-ddaf-4445-acbe-365c624f6d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172f75f-d5d1-48b5-be18-4366426afdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:19 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Volume 6b9bafea-2407-4f37-a33b-21ee8efcf79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a', 'volume_size': 1} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,created_at=2026-04-28T13:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159325209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85baae20-cc2e-46b9-afc9-d19ff9624c7e,host='devstack@QuobyteHD#QuobyteHD',id=6b9bafea-2407-4f37-a33b-21ee8efcf79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a335b76be14d42b7cb976b255d8381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:19Z,use_quota=True,user_id='22deacae429b46d8a3afaf1ca3effba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6034c54f-59fd-4137-82f1-9bebdccf29f6),volume_type_id=6034c54f-59fd-4137-82f1-9bebdccf29f6)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Creating volume 6b9bafea-2407-4f37-a33b-21ee8efcf79a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:19 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:19 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a 1073741824 Apr 28 15:17:19 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:20 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a 1073741824" returned: 0 in 1.274s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:20 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a Apr 28 15:17:20 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (6305945c-459d-4950-b397-2d76c30a3b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1fd56-33d4-44ca-839c-fc3084544571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1fd56-33d4-44ca-839c-fc3084544571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-362385115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b2fd2-100e-4de3-bdb6-4179e6dd2f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f31933bcc24418a494d50e6a521ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:21Z,use_quota=True,user_id='75963238f61c4374b9d409cde1017df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e38052d-5fd3-4125-8369-ea117a9bc460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e38052d-5fd3-4125-8369-ea117a9bc460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9dcb0d-29e8-4db9-87d4-3cb4464e8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9dcb0d-29e8-4db9-87d4-3cb4464e8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248b2fd2-100e-4de3-bdb6-4179e6dd2f2b', 'volume_name': 'volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4c9441-6e58-4f6e-bbeb-2cfdbfdef3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4c9441-6e58-4f6e-bbeb-2cfdbfdef3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e60f3d-4d97-4e14-a0d5-23fb65c8585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b', 'volume_size': 1} Apr 28 15:17:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:22 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a" returned: 0 in 1.204s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] <== create_volume: return (2571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.574s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-362385115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b2fd2-100e-4de3-bdb6-4179e6dd2f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f31933bcc24418a494d50e6a521ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:21Z,use_quota=True,user_id='75963238f61c4374b9d409cde1017df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Creating volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:22 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172f75f-d5d1-48b5-be18-4366426afdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:22 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b 1073741824 Apr 28 15:17:22 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c714e0c1-b335-48d2-8ccb-073b39a28692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Volume volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a (6b9bafea-2407-4f37-a33b-21ee8efcf79a): created successfully Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c714e0c1-b335-48d2-8ccb-073b39a28692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Flow 'volume_create_manager' (331ac32c-41ad-435a-bba1-ccaf99f48afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1d26e352-477b-4662-824b-739b12911082 tempest-GroupsTest-1201381388 None] Created volume successfully. Apr 28 15:17:22 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b 1073741824" returned: 0 in 0.926s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-01c923b6-5d3e-40b1-ac25-ae946958b0d3 tempest-GroupsTest-1201381388 None] Update group completed successfully. Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:23 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b Apr 28 15:17:23 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:23 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" returned: 0 in 0.688s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e60f3d-4d97-4e14-a0d5-23fb65c8585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e07fcc3-62ee-42f0-aef1-cec7ede1282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:23 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Volume volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b (248b2fd2-100e-4de3-bdb6-4179e6dd2f2b): created successfully Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e07fcc3-62ee-42f0-aef1-cec7ede1282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (6305945c-459d-4950-b397-2d76c30a3b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:23 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e6148e1e-e8f8-46b2-813c-1abdb5506f16 tempest-VolumesDeleteCascade-49317567 None] Created volume successfully. Apr 28 15:17:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7a47395c-e0ae-4f9e-a732-8a458e479e35 tempest-GroupsTest-1201381388 None] Update group completed successfully. Apr 28 15:17:24 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=140,cinder:UPDATE=186,cinder:DELETE=16,cinder:INSERT=44 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:17:24 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=148,cinder:INSERT=39,cinder:UPDATE=180,cinder:DELETE=11 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:17:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Creating offline snapshot b915c4ce-b079-4fbc-a118-59bdb8898402 of volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:17:25 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[318e617f-aa6e-408e-9a1a-178572281534]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:25 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b Apr 28 15:17:25 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:25 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" returned: 0 in 0.929s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:25 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 1G Apr 28 15:17:25 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Acquiring lock "cinder-quobyte-6b9bafea-2407-4f37-a33b-21ee8efcf79a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-6b9bafea-2407-4f37-a33b-21ee8efcf79a" acquired by "delete_volume" :: waited 0.037s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:26 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eda1b9-e00e-4070-8756-b1ce52505ec1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:26 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a Apr 28 15:17:26 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:27 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 1G" returned: 0 in 1.147s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:27 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:27 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:27 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a" returned: 0 in 1.269s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:27 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a Apr 28 15:17:27 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:28 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 1.159s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:28 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 is being set with open permissions: ugo+rw Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:28 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:28 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:28 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b9bafea-2407-4f37-a33b-21ee8efcf79a" returned: 0 in 1.035s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-6b9bafea-2407-4f37-a33b-21ee8efcf79a" released by "delete_volume" :: held 2.383s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Acquiring lock "cinder-quobyte-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb1275-b509-4cc0-b02f-fbd0852274d1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:28 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd Apr 28 15:17:28 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:29 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 0.837s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:29 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info Apr 28 15:17:29 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:29 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" returned: 0 in 0.964s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:29 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd Apr 28 15:17:29 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:30 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info" returned: 0 in 0.985s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:30 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info is being set with open permissions: ugo+rw Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:30 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info Apr 28 15:17:30 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:30 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" returned: 0 in 0.931s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "cinder-quobyte-df34e7a6-a420-45e9-95cc-d5b3b89e03cd" released by "delete_volume" :: held 1.963s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Created reservations ['07102636-48ff-4d9a-a21d-1aac68482469'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:30 devstack cinder-volume[84270]: WARNING cinder.quota [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-858119573 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-858119573, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:17:30 devstack cinder-volume[84270]: WARNING cinder.quota [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-858119573 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-858119573, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Created reservations ['6c9a6968-a8c7-4b48-92d5-f05f1d2339ac', 'cf26f550-3fcd-497c-ade4-efeb08b605ed', '37708165-eb07-4682-913f-2a5bdcb336bc', '58105693-7c3e-4613-a262-abdb03781056'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Created reservations ['7ed4d392-60ee-46ce-a465-145a0bf4d5e7', '7abba187-e3a4-451b-bfcd-0781eb7621f3', '5898e88a-4ccd-4694-8d95-906220ba29dc', 'a3562d42-cfb8-485b-b2b4-b6399b6b8307'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:30 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.info" returned: 0 in 0.754s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.951s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a92b1a76-5763-40bd-a110-f76155b01f0a tempest-VolumesDeleteCascade-49317567 None] Create snapshot completed successfully Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:31 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:31 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Creating offline snapshot ab261649-e1e6-4332-841f-cb294a6586f6 of volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761cb64-be6b-42b3-bee1-082f10c0cbad]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:31 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:31 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:32 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.119s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:32 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a79a69f8-39f9-485e-a596-da4eedd72996 tempest-GroupsTest-1201381388 None] Delete group completed successfully. Apr 28 15:17:32 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 1.018s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:17:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:32 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 1G Apr 28 15:17:32 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Flow 'volume_create_manager' (554eb358-bc0f-46b4-b2a5-caed4ee4962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db58c5d9-75ab-4b8d-8d5b-e77d9e3bbefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db58c5d9-75ab-4b8d-8d5b-e77d9e3bbefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1530753449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fec6c2-c4ad-4673-8dfd-6cb6f79fa471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd30c9b4b814e7e9bc076a90757c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:33Z,use_quota=True,user_id='c2542df26967499db0fedf9b99fbbf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6ce20b-04a4-48f3-a723-56a0e1713c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6ce20b-04a4-48f3-a723-56a0e1713c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39a6342-e1bb-40d8-b9d9-8d183eb85c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39a6342-e1bb-40d8-b9d9-8d183eb85c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fec6c2-c4ad-4673-8dfd-6cb6f79fa471', 'volume_name': 'volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719c287-dcdf-4219-9b79-c4d9500a8977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719c287-dcdf-4219-9b79-c4d9500a8977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6ace85-48e4-4f4d-9871-8af0b549ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:33 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Volume 07fec6c2-c4ad-4673-8dfd-6cb6f79fa471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471', 'volume_size': 1} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:33 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 1G" returned: 0 in 1.117s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:33 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 Apr 28 15:17:33 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:34 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6" returned: 0 in 0.761s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:34 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 is being set with open permissions: ugo+rw Apr 28 15:17:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:34 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 Apr 28 15:17:34 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:35 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6" returned: 0 in 0.699s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.729s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1530753449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fec6c2-c4ad-4673-8dfd-6cb6f79fa471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd30c9b4b814e7e9bc076a90757c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:33Z,use_quota=True,user_id='c2542df26967499db0fedf9b99fbbf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Creating volume 07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:35 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:35 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 1073741824 Apr 28 15:17:35 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b0824fec-e227-41dd-baac-4bf7480fa10e tempest-VolumesDeleteCascade-49317567 None] Create snapshot completed successfully Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Performing cascade delete. {{(pid=84270) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-ab261649-e1e6-4332-841f-cb294a6586f6-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-ab261649-e1e6-4332-841f-cb294a6586f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-ab261649-e1e6-4332-841f-cb294a6586f6" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-ab261649-e1e6-4332-841f-cb294a6586f6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Deleting offline snapshot ab261649-e1e6-4332-841f-cb294a6586f6 of volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] snapshot_file for this snap is: volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8d72b-d625-421e-a1a2-f9a3c0b3fe7d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:36 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 Apr 28 15:17:36 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:36 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 1073741824" returned: 0 in 1.103s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:36 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:17:36 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:37 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6" returned: 0 in 1.260s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c79913-ffb9-41b1-b562-0521a8e660b5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:37 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:37 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:37 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 1.334s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] <== create_volume: return (2486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6ace85-48e4-4f4d-9871-8af0b549ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cf5798-3456-4341-876f-bf6946d80f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Volume volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 (07fec6c2-c4ad-4673-8dfd-6cb6f79fa471): created successfully Apr 28 15:17:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cf5798-3456-4341-876f-bf6946d80f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Flow 'volume_create_manager' (554eb358-bc0f-46b4-b2a5-caed4ee4962b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c339c732-c10f-4bd3-b3f8-417b6f7994e6 tempest-SnapshotDependencyTests-524189301 None] Created volume successfully. Apr 28 15:17:39 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 2.105s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:39 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 Apr 28 15:17:39 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Creating offline snapshot 34d1658c-8d98-418e-8209-f2d4d0b4de47 of volume 07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:17:40 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca762bc-3a3b-41d7-852b-54280ce654da]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:40 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:17:40 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:41 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 1.279s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:41 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 1G Apr 28 15:17:41 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:41 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6" returned: 0 in 1.732s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:41 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6 Apr 28 15:17:41 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:42 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.ab261649-e1e6-4332-841f-cb294a6586f6" returned: 0 in 0.986s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-ab261649-e1e6-4332-841f-cb294a6586f6" released by "_delete_snapshot" :: held 6.337s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" released by "delete_snapshot" :: held 6.406s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Flow 'volume_create_manager' (2a7c2335-ae15-45f7-a3a5-ebce39dcc839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29da7b5d-5d22-402a-8631-edc2d35df667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29da7b5d-5d22-402a-8631-edc2d35df667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1641973467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139fb156-cb3b-495b-9900-de06ea7e7607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93bf03f20cd40aab8a24c713feeaabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:43Z,use_quota=True,user_id='d13e32a1c49645b68ab6f7e60ce6e426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0306373-d319-4fef-899f-e42b1b6846fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0306373-d319-4fef-899f-e42b1b6846fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71356647-8d45-4677-a478-dbd000e7c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71356647-8d45-4677-a478-dbd000e7c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139fb156-cb3b-495b-9900-de06ea7e7607', 'volume_name': 'volume-139fb156-cb3b-495b-9900-de06ea7e7607', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6fbb8b-005d-4b00-b47d-0dadaf5c629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6fbb8b-005d-4b00-b47d-0dadaf5c629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebfc580-e7da-4618-a67c-2146b44bec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:42 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Volume 139fb156-cb3b-495b-9900-de06ea7e7607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139fb156-cb3b-495b-9900-de06ea7e7607', 'volume_size': 1} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['3ad8a3f8-abef-4889-a72d-496cd574501f', '525031a1-9d4d-4993-a354-450503809dc9', '04642f0b-a796-4ba3-82e7-b35714d1933d', 'a90a1573-3951-4038-aa52-2f55d115883f'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Delete snapshot completed successfully. Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-ab261649-e1e6-4332-841f-cb294a6586f6-delete_snapshot" released by "delete_snapshot" :: held 6.806s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-b915c4ce-b079-4fbc-a118-59bdb8898402-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-b915c4ce-b079-4fbc-a118-59bdb8898402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-b915c4ce-b079-4fbc-a118-59bdb8898402" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b915c4ce-b079-4fbc-a118-59bdb8898402" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Deleting offline snapshot b915c4ce-b079-4fbc-a118-59bdb8898402 of volume 248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] snapshot_file for this snap is: volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[447824d7-0f25-4a74-b36f-c1bea5717b72]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:43 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 1G" returned: 0 in 1.975s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:43 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:17:43 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:43 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:43 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:44 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 0.969s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:44 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 is being set with open permissions: ugo+rw Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:44 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:17:44 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:44 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 1.210s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7293b1e-7059-4241-9409-7250973f40e6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:44 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b Apr 28 15:17:44 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:45 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 1.189s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:45 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info Apr 28 15:17:45 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:45 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" returned: 0 in 1.524s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:46 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:46 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:46 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info" returned: 0 in 0.806s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:46 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info is being set with open permissions: ugo+rw Apr 28 15:17:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:46 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info Apr 28 15:17:46 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:47 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 1.097s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:47 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402 Apr 28 15:17:47 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:47 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.info" returned: 0 in 1.088s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.500s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1641973467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139fb156-cb3b-495b-9900-de06ea7e7607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93bf03f20cd40aab8a24c713feeaabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:43Z,use_quota=True,user_id='d13e32a1c49645b68ab6f7e60ce6e426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Creating volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:47 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:17:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:47 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 1073741824 Apr 28 15:17:47 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:47 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-66058332-c66c-4139-bb89-59c196fd9bbf tempest-SnapshotDependencyTests-524189301 None] Create snapshot completed successfully Apr 28 15:17:48 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b.b915c4ce-b079-4fbc-a118-59bdb8898402" returned: 0 in 1.204s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b915c4ce-b079-4fbc-a118-59bdb8898402" released by "_delete_snapshot" :: held 5.259s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" released by "delete_snapshot" :: held 5.309s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['d59eae92-c79b-4f3a-84aa-3dd1be2e0868', '53d3a857-c5b3-47d1-8ac4-cfe2e3cecbe3', '5fb2460f-1aad-488d-9b94-2970864cf4e7', 'd5fdd83b-8b76-4d21-a29e-e75c0fc62006'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Delete snapshot completed successfully. Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-b915c4ce-b079-4fbc-a118-59bdb8898402-delete_snapshot" released by "delete_snapshot" :: held 5.731s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Snapshots deleted, issuing volume delete {{(pid=84270) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" acquired by "delete_volume" :: waited 0.045s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4572b35-baa6-435f-9956-69de062005fa]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:49 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b Apr 28 15:17:49 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:49 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 1073741824" returned: 0 in 1.770s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:49 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 Apr 28 15:17:49 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:50 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" returned: 0 in 1.206s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:50 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b Apr 28 15:17:50 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Flow 'volume_create_manager' (48cb6f0f-7a39-41a9-9a03-d288a202c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90af7c4-a322-4d59-80bb-91a46cd896be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90af7c4-a322-4d59-80bb-91a46cd896be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dfaa6e-b032-48dd-ae1f-70a7f4157fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd30c9b4b814e7e9bc076a90757c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34d1658c-8d98-418e-8209-f2d4d0b4de47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:50Z,use_quota=True,user_id='c2542df26967499db0fedf9b99fbbf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b623c8af-0db4-4693-b668-94f4b86d80d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b623c8af-0db4-4693-b668-94f4b86d80d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c36c433-3fd7-400f-9ca4-808310af3bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c36c433-3fd7-400f-9ca4-808310af3bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05dfaa6e-b032-48dd-ae1f-70a7f4157fec', 'volume_name': 'volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec', 'volume_size': 1, 'snapshot_id': '34d1658c-8d98-418e-8209-f2d4d0b4de47'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20b1750-4262-48c3-876e-55129ed3ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20b1750-4262-48c3-876e-55129ed3ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae69eb0-6d69-44cf-8d6b-e6bab0d02e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Volume 05dfaa6e-b032-48dd-ae1f-70a7f4157fec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec', 'volume_size': 1, 'snapshot_id': '34d1658c-8d98-418e-8209-f2d4d0b4de47'} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:50 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:50 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:50 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607" returned: 0 in 1.365s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] <== create_volume: return (3410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.416s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.666s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebfc580-e7da-4618-a67c-2146b44bec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139fb156-cb3b-495b-9900-de06ea7e7607', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe14ab82-a141-40e5-b79a-0c554730529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Creating volume 05dfaa6e-b032-48dd-ae1f-70a7f4157fec from snapshot 34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:17:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:17:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Volume volume-139fb156-cb3b-495b-9900-de06ea7e7607 (139fb156-cb3b-495b-9900-de06ea7e7607): created successfully Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe14ab82-a141-40e5-b79a-0c554730529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Flow 'volume_create_manager' (2a7c2335-ae15-45f7-a3a5-ebce39dcc839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:51 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1bc789a4-0b96-444d-b6b9-f14adb98f8d8 tempest-SnapshotsActionsTest-344484377 None] Created volume successfully. Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" acquired by "_copy_volume_from_snapshot" :: waited 0.075s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] snapshot: 34d1658c-8d98-418e-8209-f2d4d0b4de47, volume: 05dfaa6e-b032-48dd-ae1f-70a7f4157fec, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab503cf-f7c5-40b7-96cd-657e4d04ffe3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:51 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" returned: 0 in 1.206s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b" released by "delete_volume" :: held 2.512s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:51 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:17:51 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['3601fc84-d0dd-4f58-ae5c-d255feba6e3a', '1a7c19ab-881f-4fb0-895a-e3ab5ae38274', '7064afa7-d06d-4a47-ac7d-85eeec558c7e', '776c316e-eb42-4214-ae98-5e6f2ab7825e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.118s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:51 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:51 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:17:51 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:52 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 1.252s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7e1a94-bb02-4a76-95b1-92d619259030]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:52 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.019s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:17:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Deleted volume successfully. Apr 28 15:17:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a504d54d-fa97-4d6a-ac1f-a3d37e9dd769 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-248b2fd2-100e-4de3-bdb6-4179e6dd2f2b-delete_volume" released by "delete_volume" :: held 16.554s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:17:52 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:17:52 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (18a89e62-fb5a-4476-b15a-06c55d3b37db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6d566a-e0e7-49b6-aa41-5d64a139ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6d566a-e0e7-49b6-aa41-5d64a139ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1903131792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda873e1-a45e-46fe-a1ac-934024a18835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f31933bcc24418a494d50e6a521ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:53Z,use_quota=True,user_id='75963238f61c4374b9d409cde1017df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd11ec50-9953-4180-862a-51df3818b123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd11ec50-9953-4180-862a-51df3818b123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d344f527-8acc-4f75-8a5a-60ed60b50db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d344f527-8acc-4f75-8a5a-60ed60b50db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda873e1-a45e-46fe-a1ac-934024a18835', 'volume_name': 'volume-cda873e1-a45e-46fe-a1ac-934024a18835', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b96376f-1472-453b-9637-e95f96afc3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b96376f-1472-453b-9637-e95f96afc3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a265622a-f6f1-4b80-a4b0-bf940a49b8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:53 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Volume cda873e1-a45e-46fe-a1ac-934024a18835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda873e1-a45e-46fe-a1ac-934024a18835', 'volume_size': 1} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:17:53 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 1.077s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:17:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:17:53 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec Apr 28 15:17:53 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Flow 'volume_create_manager' (0e39a8fe-f4f1-4c60-b4e2-4d2a4674d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3a3218-c8c5-4238-8909-5159420698eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3a3218-c8c5-4238-8909-5159420698eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-659322020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b776c010-f23f-4b17-9300-99e3eabdbb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af193129681d4eacb89bb9e2e737e39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:00Z,use_quota=True,user_id='f8dfd9563e0c47a58b5c6714e04955c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab1b0cf-4130-40ce-9886-a6519390d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab1b0cf-4130-40ce-9886-a6519390d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a749152-3ab6-43fb-bf9a-08602f5df358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a749152-3ab6-43fb-bf9a-08602f5df358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b776c010-f23f-4b17-9300-99e3eabdbb0c', 'volume_name': 'volume-b776c010-f23f-4b17-9300-99e3eabdbb0c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:17:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6411afa4-baf0-43f2-b127-673307fb2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6411afa4-baf0-43f2-b127-673307fb2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad99506-7729-4587-ad83-295293a1d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:00 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Volume b776c010-f23f-4b17-9300-99e3eabdbb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b776c010-f23f-4b17-9300-99e3eabdbb0c', 'volume_size': 1} Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:00 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" returned: 0 in 7.386s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee8b9e-c3c3-42f9-850f-b31f70184751]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:01 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:18:01 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:01 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 0.951s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:01 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:18:01 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Converted 1024.00 MB image at 138.62 MB/s Apr 28 15:18:01 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec is being set with open permissions: ugo+rw Apr 28 15:18:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:01 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec Apr 28 15:18:01 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:02 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" returned: 0 in 0.654s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" released by "_copy_volume_from_snapshot" :: held 11.510s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" released by "_create_volume_from_snapshot" :: held 11.608s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.683s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.535s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Creating offline snapshot 8f506b31-52ab-4d0a-a175-e32c6dd127b9 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae69eb0-6d69-44cf-8d6b-e6bab0d02e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec', 'volume_size': 1, 'snapshot_id': '34d1658c-8d98-418e-8209-f2d4d0b4de47'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113eac19-8df9-4318-9fa9-e152572e0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0599f13-95f8-4fa6-b6cd-6cbd212f3242]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:02 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Volume volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec (05dfaa6e-b032-48dd-ae1f-70a7f4157fec): created successfully Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113eac19-8df9-4318-9fa9-e152572e0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Flow 'volume_create_manager' (48cb6f0f-7a39-41a9-9a03-d288a202c520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:02 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f2b49f5f-b71f-456c-8f97-575b7b507221 tempest-SnapshotDependencyTests-524189301 None] Created volume successfully. Apr 28 15:18:02 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 Apr 28 15:18:02 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:03 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607" returned: 0 in 0.792s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:03 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 1G Apr 28 15:18:03 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-34d1658c-8d98-418e-8209-f2d4d0b4de47-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-34d1658c-8d98-418e-8209-f2d4d0b4de47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Deleting offline snapshot 34d1658c-8d98-418e-8209-f2d4d0b4de47 of volume 07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] snapshot_file for this snap is: volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41e5b7b-1f1b-40c4-bb12-a4fed90d09e4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:03 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:18:03 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:04 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 1G" returned: 0 in 0.898s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:04 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:04 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:04 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 0.784s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03cd11f-58b9-49d4-9857-4d0042182659]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:04 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:18:04 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:05 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.709s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:05 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 is being set with open permissions: ugo+rw Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:05 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:05 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:05 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 0.860s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:05 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:18:05 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:05 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.726s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:05 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info Apr 28 15:18:05 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:06 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 0.785s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:06 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47 Apr 28 15:18:06 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:06 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info" returned: 0 in 0.663s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:06 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info is being set with open permissions: ugo+rw Apr 28 15:18:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:06 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info Apr 28 15:18:06 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:06 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471.34d1658c-8d98-418e-8209-f2d4d0b4de47" returned: 0 in 0.668s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-34d1658c-8d98-418e-8209-f2d4d0b4de47" released by "_delete_snapshot" :: held 3.236s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" released by "delete_snapshot" :: held 3.272s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Created reservations ['8ad410b1-f973-4739-9a5f-50bff6ac6390', '4c9e6a6d-b623-4a43-8c80-ba02b059ed83', '109dec74-3994-4c0a-b3fe-f4ad406f28f6', '9f7c3cde-11b3-4553-ae12-8402bd62ee6a'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:07 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.info" returned: 0 in 0.685s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.060s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1903131792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda873e1-a45e-46fe-a1ac-934024a18835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f31933bcc24418a494d50e6a521ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:17:53Z,use_quota=True,user_id='75963238f61c4374b9d409cde1017df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Creating volume cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:07 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:07 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 1073741824 Apr 28 15:18:07 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8c21cceb-da59-4758-8a16-6f98f2f0e25a tempest-SnapshotsActionsTest-344484377 None] Create snapshot completed successfully Apr 28 15:18:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Delete snapshot completed successfully. Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d88edd62-2e1c-4225-a8b0-04bbb6c88b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-34d1658c-8d98-418e-8209-f2d4d0b4de47-delete_snapshot" released by "delete_snapshot" :: held 3.564s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b74a7-7b92-4b84-a793-fceb489050f7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:08 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 1073741824" returned: 0 in 0.854s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:08 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:08 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:08 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:18:08 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:08 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 0.693s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.730s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-659322020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b776c010-f23f-4b17-9300-99e3eabdbb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af193129681d4eacb89bb9e2e737e39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:00Z,use_quota=True,user_id='f8dfd9563e0c47a58b5c6714e04955c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Creating volume b776c010-f23f-4b17-9300-99e3eabdbb0c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:08 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:08 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 0.780s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:08 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c 1073741824 Apr 28 15:18:08 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a265622a-f6f1-4b80-a4b0-bf940a49b8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda873e1-a45e-46fe-a1ac-934024a18835', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b09d4c6-98b7-43a5-b497-cd7bd70cb5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:08 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471 Apr 28 15:18:08 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:08 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Volume volume-cda873e1-a45e-46fe-a1ac-934024a18835 (cda873e1-a45e-46fe-a1ac-934024a18835): created successfully Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b09d4c6-98b7-43a5-b497-cd7bd70cb5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (18a89e62-fb5a-4476-b15a-06c55d3b37db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2c67c863-e655-4000-9cab-3b2429009414 tempest-VolumesDeleteCascade-49317567 None] Created volume successfully. Apr 28 15:18:09 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" returned: 0 in 0.659s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471" released by "delete_volume" :: held 1.501s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Created reservations ['2563d0a4-505f-4c70-9734-536f9f87cc94', '018159b7-76bd-4ffb-bce3-b207f2eba390', 'ef6c8b44-7dc0-4742-8719-4373c27fa6d5', '21fd3b39-ab4c-4535-a103-3d2eaee9d4e8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:09 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:09 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:09 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c 1073741824" returned: 0 in 0.846s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:09 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c Apr 28 15:18:09 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-05dfaa6e-b032-48dd-ae1f-70a7f4157fec-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-05dfaa6e-b032-48dd-ae1f-70a7f4157fec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:10 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.628s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:10 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Deleted volume successfully. Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70286ff1-fb3f-4c02-bd46-355c4e546b70 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-07fec6c2-c4ad-4673-8dfd-6cb6f79fa471-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eefab4-f9f2-4f36-a68b-799dd023b7bc]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:10 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.510s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad99506-7729-4587-ad83-295293a1d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b776c010-f23f-4b17-9300-99e3eabdbb0c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1a952e-0337-4949-a9ab-0da9afdbaec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Creating offline snapshot 8609be4b-1b8c-42a7-87bd-8fae0b150125 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:10 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Volume volume-b776c010-f23f-4b17-9300-99e3eabdbb0c (b776c010-f23f-4b17-9300-99e3eabdbb0c): created successfully Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1a952e-0337-4949-a9ab-0da9afdbaec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Flow 'volume_create_manager' (0e39a8fe-f4f1-4c60-b4e2-4d2a4674d49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[656327c6-0cd1-46d0-9331-10cfcb73a0c5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:10 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec Apr 28 15:18:10 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:10 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ef8179ca-9a69-46ad-9b3e-79014cb10c42 tempest-ServerRescueNegativeTestJSON-600286470 None] Created volume successfully. Apr 28 15:18:10 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:10 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:11 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" returned: 0 in 0.779s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:11 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec Apr 28 15:18:11 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:11 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.815s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:11 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 1G Apr 28 15:18:11 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:11 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" returned: 0 in 0.632s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-quobyte-05dfaa6e-b032-48dd-ae1f-70a7f4157fec" released by "delete_volume" :: held 1.465s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Created reservations ['9de9f150-976c-4683-a95c-40c1226de544', '0dbf006d-eee1-41ad-b3ef-8fee4a5b5ffd', 'eb454cc5-1d16-45a5-b816-d84285d0bed5', '30b115e5-dda0-491d-b297-5f9c827081d3'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:11 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:11 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:12 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 1G" returned: 0 in 0.910s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:12 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 Apr 28 15:18:12 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:12 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.688s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Deleted volume successfully. Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7b61e9d4-b246-4c71-9525-89170d9f2bb2 tempest-SnapshotDependencyTests-524189301 None] Lock "cinder-05dfaa6e-b032-48dd-ae1f-70a7f4157fec-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:12 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125" returned: 0 in 0.680s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:12 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 is being set with open permissions: ugo+rw Apr 28 15:18:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:12 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 Apr 28 15:18:12 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:13 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125" returned: 0 in 0.689s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.485s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Creating offline snapshot b5e63e36-9d82-4c3b-becf-c55a0fd57f9e of volume cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-bf7fbbcf-2c70-40bb-96d1-d57cca211d29 tempest-SnapshotsActionsTest-344484377 None] Create snapshot completed successfully Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7442e-6dce-4f7b-b523-163dc8fd88a8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:13 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:13 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-8609be4b-1b8c-42a7-87bd-8fae0b150125-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-8609be4b-1b8c-42a7-87bd-8fae0b150125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-8609be4b-1b8c-42a7-87bd-8fae0b150125" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-8609be4b-1b8c-42a7-87bd-8fae0b150125" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Deleting offline snapshot 8609be4b-1b8c-42a7-87bd-8fae0b150125 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] snapshot_file for this snap is: volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25aaec-b5ca-4bf7-a2a3-f09d93b8e50f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:14 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 Apr 28 15:18:14 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:14 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 1.058s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:14 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e 1G Apr 28 15:18:14 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:15 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125" returned: 0 in 1.309s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adfac57-a7f0-4b28-8b03-2e85e2f39de3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:15 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:15 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:15 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e 1G" returned: 0 in 1.293s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda873e1-a45e-46fe-a1ac-934024a18835 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:16 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda873e1-a45e-46fe-a1ac-934024a18835 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:16 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:16 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.969s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:16 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 Apr 28 15:18:16 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:17 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda873e1-a45e-46fe-a1ac-934024a18835 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 1.064s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:17 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e is being set with open permissions: ugo+rw Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:17 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:17 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:17 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125" returned: 0 in 1.021s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:17 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125 Apr 28 15:18:17 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:17 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 0.740s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:17 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info Apr 28 15:18:17 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:18 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8609be4b-1b8c-42a7-87bd-8fae0b150125" returned: 0 in 0.647s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-8609be4b-1b8c-42a7-87bd-8fae0b150125" released by "_delete_snapshot" :: held 4.112s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_snapshot" :: held 4.140s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Created reservations ['88ca4023-87a6-453c-b8f9-304f5a097d85', '886d7f1e-b408-422f-91fa-1462259b19b7', '1b7b4f7f-ab26-40dc-8af1-19766d216319', 'ca1b2df9-cba4-4eb0-afde-90118a73cd4b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Delete snapshot completed successfully. Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-eca6d3b4-9923-47a9-8313-7c9c8b7dc0a2 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-8609be4b-1b8c-42a7-87bd-8fae0b150125-delete_snapshot" released by "delete_snapshot" :: held 4.329s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:18 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info" returned: 0 in 0.742s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:18 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info is being set with open permissions: ugo+rw Apr 28 15:18:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:18 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info Apr 28 15:18:18 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:19 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.info" returned: 0 in 0.603s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.627s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8dd74f49-2065-4ca9-a0ae-78e1f0393508 tempest-VolumesDeleteCascade-49317567 None] Create snapshot completed successfully Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Creating offline snapshot 2c57cad0-983c-406e-b59c-815b1bb4349d of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e091fe-ed8e-49f9-b414-b034903e06c6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:20 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:20 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (9970f075-7c85-40f6-b254-75635859b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179ba43a-1b05-459b-810e-d6e12eefcd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179ba43a-1b05-459b-810e-d6e12eefcd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44329235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93a2a1-b574-4604-9a5a-aeadbd912cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f31933bcc24418a494d50e6a521ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5e63e36-9d82-4c3b-becf-c55a0fd57f9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:20Z,use_quota=True,user_id='75963238f61c4374b9d409cde1017df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23b9e31-9c80-412c-b059-f6f66ef0b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23b9e31-9c80-412c-b059-f6f66ef0b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bafc7d9-8004-4a11-acdf-96b967ff092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bafc7d9-8004-4a11-acdf-96b967ff092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa93a2a1-b574-4604-9a5a-aeadbd912cb2', 'volume_name': 'volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2', 'volume_size': 1, 'snapshot_id': 'b5e63e36-9d82-4c3b-becf-c55a0fd57f9e'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587ae01c-7b06-41d6-a54a-483cff48d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587ae01c-7b06-41d6-a54a-483cff48d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83a570e-6173-4594-abc7-c4db6dd9d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:20 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Volume aa93a2a1-b574-4604-9a5a-aeadbd912cb2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2', 'volume_size': 1, 'snapshot_id': 'b5e63e36-9d82-4c3b-becf-c55a0fd57f9e'} Apr 28 15:18:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:21 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 1.371s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:21 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d 1G Apr 28 15:18:21 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:22 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d 1G" returned: 0 in 1.076s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:22 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d Apr 28 15:18:22 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:23 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d" returned: 0 in 0.938s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:23 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d is being set with open permissions: ugo+rw Apr 28 15:18:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:23 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d Apr 28 15:18:23 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:24 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d" returned: 0 in 0.725s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.283s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.691s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Creating volume aa93a2a1-b574-4604-9a5a-aeadbd912cb2 from snapshot b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7d005d63-58f6-4194-9060-84819ef465b2 tempest-SnapshotsActionsTest-344484377 None] Create snapshot completed successfully Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] snapshot: b5e63e36-9d82-4c3b-becf-c55a0fd57f9e, volume: aa93a2a1-b574-4604-9a5a-aeadbd912cb2, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef1261-a68d-4881-a834-b2a73df8cf18]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:24 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:24 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:25 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 0.776s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda873e1-a45e-46fe-a1ac-934024a18835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b10cc1c-42c4-4eb4-9845-4b96995a838e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:25 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:25 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-2c57cad0-983c-406e-b59c-815b1bb4349d-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-2c57cad0-983c-406e-b59c-815b1bb4349d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-2c57cad0-983c-406e-b59c-815b1bb4349d" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-2c57cad0-983c-406e-b59c-815b1bb4349d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Deleting offline snapshot 2c57cad0-983c-406e-b59c-815b1bb4349d of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] snapshot_file for this snap is: volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[71445a8d-7608-4430-a1a2-04d922fe9955]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:25 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d Apr 28 15:18:25 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:26 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 0.962s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:26 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 Apr 28 15:18:26 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:26 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d" returned: 0 in 1.010s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd47c7-ff3c-4ba1-91be-b9c2fe49606a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:26 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:26 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:27 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 1.369s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:28 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d Apr 28 15:18:28 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Acquiring lock "cinder-b776c010-f23f-4b17-9300-99e3eabdbb0c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "cinder-b776c010-f23f-4b17-9300-99e3eabdbb0c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=84,cinder:UPDATE=90,cinder:INSERT=16,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=84,cinder:INSERT=29,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Acquiring lock "cinder-quobyte-b776c010-f23f-4b17-9300-99e3eabdbb0c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "cinder-quobyte-b776c010-f23f-4b17-9300-99e3eabdbb0c" acquired by "delete_volume" :: waited 0.078s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013982f-fbc7-4a0a-b50f-7ec4a3c8de30]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:30 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c Apr 28 15:18:30 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:31 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d" returned: 0 in 3.252s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:31 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d Apr 28 15:18:31 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:33 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c" returned: 0 in 2.861s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:33 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:33 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c Apr 28 15:18:33 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.2c57cad0-983c-406e-b59c-815b1bb4349d" returned: 0 in 2.248s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-2c57cad0-983c-406e-b59c-815b1bb4349d" released by "_delete_snapshot" :: held 8.067s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_snapshot" :: held 8.121s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Created reservations ['4326cdb9-2d2b-4373-9622-f712c85c4ea4', '47e06ba1-1633-4f1b-b8cd-68145d806e28', '54eeffa2-c3ee-4738-afe6-7f796f5c2560', '453b4dd7-ca42-481e-a8a5-8262f6c1e309'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:33 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:33 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Delete snapshot completed successfully. Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" returned: 0 in 7.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b1fe9d01-69d5-46df-af43-5321ee6218a1 tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-2c57cad0-983c-406e-b59c-815b1bb4349d-delete_snapshot" released by "delete_snapshot" :: held 8.438s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c827075-6b24-4acb-9394-ac20cc9a7ec8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:33 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:33 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:34 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b776c010-f23f-4b17-9300-99e3eabdbb0c" returned: 0 in 0.948s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "cinder-quobyte-b776c010-f23f-4b17-9300-99e3eabdbb0c" released by "delete_volume" :: held 3.941s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Created reservations ['aa3f44f3-773c-42c2-b3aa-a57c66c42934', '5df33e89-b169-4358-8b74-916ca55a4ba7', '0fc26109-9521-40af-9971-32928744cc42', 'c7214ce8-9998-438e-a7ab-d122300e8881'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:34 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:34 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:34 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 1.085s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:18:34 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Converted 1024.00 MB image at 134.30 MB/s Apr 28 15:18:34 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 is being set with open permissions: ugo+rw Apr 28 15:18:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:34 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 Apr 28 15:18:34 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:35 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.730s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Deleted volume successfully. Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-86929956-e125-4a98-83df-211b0ac0a4a1 tempest-ServerRescueNegativeTestJSON-600286470 None] Lock "cinder-b776c010-f23f-4b17-9300-99e3eabdbb0c-delete_volume" released by "delete_volume" :: held 5.164s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:35 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" returned: 0 in 0.706s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" released by "_copy_volume_from_snapshot" :: held 11.286s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" released by "_create_volume_from_snapshot" :: held 11.334s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.372s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.841s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Creating offline snapshot 7519d05e-d8b3-48de-92cd-18a39f0249e5 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83a570e-6173-4594-abc7-c4db6dd9d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2', 'volume_size': 1, 'snapshot_id': 'b5e63e36-9d82-4c3b-becf-c55a0fd57f9e'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f29af8d-cf3e-4241-873b-20af855c6dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[32584b03-0bea-446f-b46b-cbcda2cc8e33]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Volume volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 (aa93a2a1-b574-4604-9a5a-aeadbd912cb2): created successfully Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f29af8d-cf3e-4241-873b-20af855c6dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Flow 'volume_create_manager' (9970f075-7c85-40f6-b254-75635859b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-68de3680-6d0b-4e1a-bffb-b86c1db83344 tempest-VolumesDeleteCascade-49317567 None] Created volume successfully. Apr 28 15:18:35 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:35 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-cda873e1-a45e-46fe-a1ac-934024a18835-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-cda873e1-a45e-46fe-a1ac-934024a18835-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:37 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Performing cascade delete. {{(pid=84270) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 1.273s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:37 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 1G Apr 28 15:18:37 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Deleting offline snapshot b5e63e36-9d82-4c3b-becf-c55a0fd57f9e of volume cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] snapshot_file for this snap is: volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a78fb2d-8794-41b8-b081-8f61599724ad]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:37 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:37 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:38 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 1G" returned: 0 in 1.218s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:38 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 Apr 28 15:18:38 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:38 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 0.999s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda873e1-a45e-46fe-a1ac-934024a18835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb0df5d-f05c-4624-96e9-ad72a8976e65]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:38 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:38 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:39 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5" returned: 0 in 0.843s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:39 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 is being set with open permissions: ugo+rw Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:39 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 Apr 28 15:18:39 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:39 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 0.957s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:39 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:39 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:39 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5" returned: 0 in 0.707s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:39 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7d416832-d135-4c5a-8cc5-0abea21ba358 tempest-SnapshotsActionsTest-344484377 None] Create snapshot completed successfully Apr 28 15:18:40 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 0.809s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:40 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e Apr 28 15:18:40 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-7519d05e-d8b3-48de-92cd-18a39f0249e5-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-7519d05e-d8b3-48de-92cd-18a39f0249e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-7519d05e-d8b3-48de-92cd-18a39f0249e5" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-7519d05e-d8b3-48de-92cd-18a39f0249e5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Deleting offline snapshot 7519d05e-d8b3-48de-92cd-18a39f0249e5 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] snapshot_file for this snap is: volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b46e001-3e35-42fd-abe8-051a2b353a0b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:40 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 Apr 28 15:18:40 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:41 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835.b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" returned: 0 in 0.902s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e" released by "_delete_snapshot" :: held 3.834s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" released by "delete_snapshot" :: held 3.876s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['250862c5-cdc8-43ed-bd06-4384e1df330b', 'acdeaebd-feef-4a5e-9335-6d930e063eb1', 'd47e2dd8-b9af-448a-8921-63092f6d80e0', '6c1af364-ef1a-4c36-85dc-7c46f66467f9'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Delete snapshot completed successfully. Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-b5e63e36-9d82-4c3b-becf-c55a0fd57f9e-delete_snapshot" released by "delete_snapshot" :: held 4.201s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Snapshots deleted, issuing volume delete {{(pid=84270) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d786d8e9-f544-4c4f-a53b-2240c26bfd9b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:41 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5" returned: 0 in 1.029s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ff149-3e94-4cea-aa6b-283fe66be9ef]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:41 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:41 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:41 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:41 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:42 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 0.821s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:42 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835 Apr 28 15:18:42 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:42 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.832s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:42 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 Apr 28 15:18:42 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:42 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cda873e1-a45e-46fe-a1ac-934024a18835" returned: 0 in 0.713s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-cda873e1-a45e-46fe-a1ac-934024a18835" released by "delete_volume" :: held 1.638s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['fbdfc1d3-93ab-4374-8425-7ff03c2eab1b', '38a17939-eef9-4267-be5e-e915fa88fbd4', 'bd4c9bea-76e4-47cd-9986-0ca9111d6814', '07945135-0ad5-401b-8114-0da42da19f46'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:43 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:43 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:43 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5" returned: 0 in 0.786s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:43 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5 Apr 28 15:18:43 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-aa93a2a1-b574-4604-9a5a-aeadbd912cb2-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-aa93a2a1-b574-4604-9a5a-aeadbd912cb2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:44 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0eb0e4-ff49-4b90-b355-e24a78b5b491]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.948s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Deleted volume successfully. Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b972f63d-4abe-4c86-a4ad-3545c4bcad86 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-cda873e1-a45e-46fe-a1ac-934024a18835-delete_volume" released by "delete_volume" :: held 7.222s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:44 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.7519d05e-d8b3-48de-92cd-18a39f0249e5" returned: 0 in 1.072s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:44 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 Apr 28 15:18:44 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-7519d05e-d8b3-48de-92cd-18a39f0249e5" released by "_delete_snapshot" :: held 3.847s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_snapshot" :: held 3.884s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Created reservations ['be495287-8e74-4aef-9073-3e01111fd0e7', 'c21fb5ed-33d4-4860-8c9a-8ae0e6c98b85', '2ab97d2a-a54a-43c1-8b67-c7942f555ee6', '6c5ad550-cbb1-40a3-9bce-3dacb48cf322'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Delete snapshot completed successfully. Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-cfece390-260d-4f31-9fb8-4b419f99535d tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-7519d05e-d8b3-48de-92cd-18a39f0249e5-delete_snapshot" released by "delete_snapshot" :: held 4.047s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:44 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" returned: 0 in 0.862s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:44 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2 Apr 28 15:18:44 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Creating offline snapshot efcca552-b63f-4f7e-b577-7425ee92b598 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73da89-fa6f-4412-ab80-2c213ed53b0e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:45 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:45 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:45 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" returned: 0 in 0.709s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-quobyte-aa93a2a1-b574-4604-9a5a-aeadbd912cb2" released by "delete_volume" :: held 1.630s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Created reservations ['189018a7-5825-4fe7-b2ed-162b8c5af6e5', 'd0d64ca5-f50c-497f-b220-cff1361c750d', '47c3316e-7fa2-4156-a591-22d4d12ebdd5', '058f5fc6-a5cb-4eef-8cc4-adead810ddba'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:45 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:45 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:45 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.773s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:45 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 1G Apr 28 15:18:45 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:46 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.665s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:46 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Deleted volume successfully. Apr 28 15:18:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ec73cc30-3016-445f-adc5-ce15d0039141 tempest-VolumesDeleteCascade-49317567 None] Lock "cinder-aa93a2a1-b574-4604-9a5a-aeadbd912cb2-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:46 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 1G" returned: 0 in 0.898s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:46 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 Apr 28 15:18:46 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:47 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598" returned: 0 in 0.713s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:47 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 is being set with open permissions: ugo+rw Apr 28 15:18:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:47 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 Apr 28 15:18:47 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:48 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598" returned: 0 in 0.673s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c108b10a-e7e0-45ee-9cb2-32a5c9ff0461 tempest-SnapshotsActionsTest-344484377 None] Create snapshot completed successfully Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (282c1f4b-2eb1-4020-a5f1-600cf23daf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefca2c4-a086-43aa-96e9-f7b5e6b089e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefca2c4-a086-43aa-96e9-f7b5e6b089e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461554838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b49280a-9e93-496e-b747-51c5300bab07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:49Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7858b837-c02c-409e-8f9a-4999086aa7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7858b837-c02c-409e-8f9a-4999086aa7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f24a4c4-3358-4c42-b854-0d8c343341b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f24a4c4-3358-4c42-b854-0d8c343341b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b49280a-9e93-496e-b747-51c5300bab07', 'volume_name': 'volume-8b49280a-9e93-496e-b747-51c5300bab07', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccff0ba-add0-4e75-b7e4-982264be4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccff0ba-add0-4e75-b7e4-982264be4e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd6b492-3e22-4b5c-87d6-a448bec081da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:49 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Volume 8b49280a-9e93-496e-b747-51c5300bab07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b49280a-9e93-496e-b747-51c5300bab07', 'volume_size': 1} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461554838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b49280a-9e93-496e-b747-51c5300bab07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:49Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Creating volume 8b49280a-9e93-496e-b747-51c5300bab07 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:49 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:49 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 1073741824 Apr 28 15:18:49 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-efcca552-b63f-4f7e-b577-7425ee92b598-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-efcca552-b63f-4f7e-b577-7425ee92b598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Acquiring lock "cinder-quobyte-efcca552-b63f-4f7e-b577-7425ee92b598" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-efcca552-b63f-4f7e-b577-7425ee92b598" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Deleting offline snapshot efcca552-b63f-4f7e-b577-7425ee92b598 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] snapshot_file for this snap is: volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0acedfb-3e9a-4c68-b25b-59e901c8ddb9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:49 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 Apr 28 15:18:49 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:50 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 1073741824" returned: 0 in 0.991s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:50 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598" returned: 0 in 0.821s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:50 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:50 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b23a1-0120-43d2-8ee2-a77221d7222f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:50 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:50 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:50 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:50 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:50 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07" returned: 0 in 0.705s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd6b492-3e22-4b5c-87d6-a448bec081da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b49280a-9e93-496e-b747-51c5300bab07', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c55f19a-441b-4d6c-a49f-157b5b91932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Volume volume-8b49280a-9e93-496e-b747-51c5300bab07 (8b49280a-9e93-496e-b747-51c5300bab07): created successfully Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c55f19a-441b-4d6c-a49f-157b5b91932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (282c1f4b-2eb1-4020-a5f1-600cf23daf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-89e1c063-7ed7-4fe9-a43b-ca9c2aa9e8d4 tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:18:51 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.860s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:51 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 Apr 28 15:18:51 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:51 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.710s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (c1cf88cb-5f7e-4175-9549-d0eb28d5e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:51 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e4db3b-0476-467e-9b60-b9c092723b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e4db3b-0476-467e-9b60-b9c092723b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2125989687',display_name='tempest-VolumesGetTest-Volume-1475629296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b5ed9-d89d-4962-9640-813750ab228f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:52Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6bdba-9bbe-4579-95b3-67e3a15f32f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6bdba-9bbe-4579-95b3-67e3a15f32f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a6bfd-55ea-419b-a72c-a35a03d82163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a6bfd-55ea-419b-a72c-a35a03d82163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981b5ed9-d89d-4962-9640-813750ab228f', 'volume_name': 'volume-981b5ed9-d89d-4962-9640-813750ab228f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b429d98-f589-4616-acc4-6d3081bfbe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b429d98-f589-4616-acc4-6d3081bfbe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bb24ae-eae8-4534-9c83-e22a97cfc274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:52 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Volume 981b5ed9-d89d-4962-9640-813750ab228f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981b5ed9-d89d-4962-9640-813750ab228f', 'volume_size': 1} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2125989687',display_name='tempest-VolumesGetTest-Volume-1475629296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b5ed9-d89d-4962-9640-813750ab228f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:52Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Creating volume 981b5ed9-d89d-4962-9640-813750ab228f {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:52 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:52 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598" returned: 0 in 0.953s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:52 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f 1073741824 Apr 28 15:18:52 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:52 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598 Apr 28 15:18:52 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:52 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.efcca552-b63f-4f7e-b577-7425ee92b598" returned: 0 in 0.716s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-efcca552-b63f-4f7e-b577-7425ee92b598" released by "_delete_snapshot" :: held 3.517s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_snapshot" :: held 3.556s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:52 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Created reservations ['16f08b2b-57cc-40d9-b48d-d42d54ab3df9', '340b4873-db2f-420a-ac7a-3c40a3bc80dd', '0417066c-bbe6-40d5-b6bf-d1bdb18b7215', '9cfa3a48-4e2a-4d8e-9cbf-98c61b2f2281'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:53 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Delete snapshot completed successfully. Apr 28 15:18:53 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5f694ad7-0298-4982-9d19-ad9a0b77ab4b tempest-SnapshotsActionsTest-735308482 None] Lock "cinder-efcca552-b63f-4f7e-b577-7425ee92b598-delete_snapshot" released by "delete_snapshot" :: held 3.748s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f 1073741824" returned: 0 in 0.973s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:53 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f Apr 28 15:18:53 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:53 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f" returned: 0 in 0.675s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bb24ae-eae8-4534-9c83-e22a97cfc274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981b5ed9-d89d-4962-9640-813750ab228f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2fbf27-fce9-4271-aa45-e845e3786e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:53 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Volume volume-981b5ed9-d89d-4962-9640-813750ab228f (981b5ed9-d89d-4962-9640-813750ab228f): created successfully Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2fbf27-fce9-4271-aa45-e845e3786e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (c1cf88cb-5f7e-4175-9549-d0eb28d5e31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:53 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-23114187-721e-44c2-a0ce-a018c22acd94 tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "cinder-8f506b31-52ab-4d0a-a175-e32c6dd127b9-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-8f506b31-52ab-4d0a-a175-e32c6dd127b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "cinder-quobyte-8f506b31-52ab-4d0a-a175-e32c6dd127b9" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-8f506b31-52ab-4d0a-a175-e32c6dd127b9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Deleting offline snapshot 8f506b31-52ab-4d0a-a175-e32c6dd127b9 of volume 139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] snapshot_file for this snap is: volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb27c7-fdfb-4a14-ace3-700a704eee70]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-981b5ed9-d89d-4962-9640-813750ab228f-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "cinder-981b5ed9-d89d-4962-9640-813750ab228f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:54 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:54 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-981b5ed9-d89d-4962-9640-813750ab228f" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-981b5ed9-d89d-4962-9640-813750ab228f" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119ff5f-e27d-4834-aa8b-afd5255931fd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:54 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f Apr 28 15:18:54 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:55 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.856s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb156-cb3b-495b-9900-de06ea7e7607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ab80b-f188-489f-a81e-75f3252dd039]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:55 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 Apr 28 15:18:55 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:55 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f" returned: 0 in 0.818s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:55 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f Apr 28 15:18:55 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:55 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-981b5ed9-d89d-4962-9640-813750ab228f" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-981b5ed9-d89d-4962-9640-813750ab228f" released by "delete_volume" :: held 1.490s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:55 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607" returned: 0 in 0.800s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:55 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:55 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Created reservations ['e0a69374-6bd6-4374-82f9-89f7de57b57a', 'e485dfe0-5538-44ee-9815-959a1a24e8ca', '4fa96730-fb40-4b37-a132-258611e35d77', 'e1c9a147-1cfa-4658-8a87-51119faa4197'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:56 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:56 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-8b49280a-9e93-496e-b747-51c5300bab07-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7db78e06-826a-48f2-ac43-7243e5ba371d tempest-GroupsV314Test-1968689586 None] Group tempest-GroupsV314Test-Group-1148542094: creating Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "cinder-8b49280a-9e93-496e-b747-51c5300bab07-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7db78e06-826a-48f2-ac43-7243e5ba371d tempest-GroupsV314Test-1968689586 None] Group tempest-GroupsV314Test-Group-1148542094: created successfully Apr 28 15:18:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7db78e06-826a-48f2-ac43-7243e5ba371d tempest-GroupsV314Test-1968689586 None] Create group completed successfully. Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-8b49280a-9e93-496e-b747-51c5300bab07" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:56 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-8b49280a-9e93-496e-b747-51c5300bab07" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:56 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.883s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.742s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[439403be-400e-4d7b-a463-68a0d998c887]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:56 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9 Apr 28 15:18:56 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:56 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:18:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-962bf743-47eb-4d53-a2e8-d78373949bc3 tempest-VolumesGetTest-459901914 None] Lock "cinder-981b5ed9-d89d-4962-9640-813750ab228f-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:56 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 Apr 28 15:18:56 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:57 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607.8f506b31-52ab-4d0a-a175-e32c6dd127b9" returned: 0 in 0.652s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-8f506b31-52ab-4d0a-a175-e32c6dd127b9" released by "_delete_snapshot" :: held 3.319s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_snapshot" :: held 3.340s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Created reservations ['4b460660-1dbf-4773-9570-8a55537bcace', '2ce97e39-051e-45d0-9774-be4cbe945a67', '06b1ccda-c36e-4a40-a5e5-b5a9e513927f', 'ace3b353-3a19-4664-b929-d9c1d6fd6bce'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:57 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07" returned: 0 in 0.754s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:57 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07 Apr 28 15:18:57 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:57 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Delete snapshot completed successfully. Apr 28 15:18:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a25bfd62-4a28-4f49-9402-62ea4ad328e3 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-8f506b31-52ab-4d0a-a175-e32c6dd127b9-delete_snapshot" released by "delete_snapshot" :: held 3.506s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Flow 'volume_create_manager' (2dd5eaca-d0fa-4603-981d-7fc74cd3a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7ddf8-b842-4afd-b9c1-980448c4292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7ddf8-b842-4afd-b9c1-980448c4292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1188035232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf130cfa-e3eb-425b-8234-93c04b807ef8,host='devstack@QuobyteHD#QuobyteHD',id=30d7bc29-a5bf-4fa3-b0a0-77b986d63585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a41c2d691a45b7a9f9672dfe02ce14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:58Z,use_quota=True,user_id='02aee74485a1497c8c9b79f9eafe36b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36dc41be-c2c0-49f2-bc1e-bdda61628daa),volume_type_id=36dc41be-c2c0-49f2-bc1e-bdda61628daa)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab94e93-c25e-4e1a-a5ee-f028e3ed1204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab94e93-c25e-4e1a-a5ee-f028e3ed1204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e570d07-a515-45d0-9853-4128306a028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e570d07-a515-45d0-9853-4128306a028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d7bc29-a5bf-4fa3-b0a0-77b986d63585', 'volume_name': 'volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf9aafb-b402-4774-b30c-a582d3c32e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf9aafb-b402-4774-b30c-a582d3c32e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4c63c4-55d3-4959-8e45-2796d5d0c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:58 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Volume 30d7bc29-a5bf-4fa3-b0a0-77b986d63585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585', 'volume_size': 1} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf130cfa-e3eb-425b-8234-93c04b807ef8,created_at=2026-04-28T13:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1188035232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf130cfa-e3eb-425b-8234-93c04b807ef8,host='devstack@QuobyteHD#QuobyteHD',id=30d7bc29-a5bf-4fa3-b0a0-77b986d63585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a41c2d691a45b7a9f9672dfe02ce14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:58Z,use_quota=True,user_id='02aee74485a1497c8c9b79f9eafe36b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36dc41be-c2c0-49f2-bc1e-bdda61628daa),volume_type_id=36dc41be-c2c0-49f2-bc1e-bdda61628daa)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:58 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Creating volume 30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:58 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8b49280a-9e93-496e-b747-51c5300bab07" returned: 0 in 0.712s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:58 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 1073741824 Apr 28 15:18:58 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-8b49280a-9e93-496e-b747-51c5300bab07" released by "delete_volume" :: held 1.524s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Created reservations ['ae8a42d7-84d7-4dc1-9e89-78305004d14b', '620e53e8-b038-44f9-ae16-930f7d8bebab', '8de8242b-74e0-4825-81ea-5efba6143ada', '8eede8b1-db9a-4b81-a733-89ec72e4e2a1'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "cinder-139fb156-cb3b-495b-9900-de06ea7e7607-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-139fb156-cb3b-495b-9900-de06ea7e7607-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:58 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:18:58 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d131c-7637-492b-b1f9-aee9474a1a1c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:18:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:58 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 Apr 28 15:18:58 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:59 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.695s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:18:59 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-22d6eba5-a73e-4c23-8d0e-244fb1659c6c tempest-VolumesGetTest-459901914 None] Lock "cinder-8b49280a-9e93-496e-b747-51c5300bab07-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:18:59 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 1073741824" returned: 0 in 0.971s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:59 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:18:59 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:59 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (13ad4525-7e3e-4233-8cba-f4f32bb6861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc0319c-4e0e-4c88-a34b-30af738acf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607" returned: 0 in 0.915s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc0319c-4e0e-4c88-a34b-30af738acf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-432432558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:59Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607 Apr 28 15:18:59 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caf8f46-8dcc-406b-8bc4-0a20173bd378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caf8f46-8dcc-406b-8bc4-0a20173bd378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4873d6-e471-49b0-92bd-27686b8c41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4873d6-e471-49b0-92bd-27686b8c41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'volume_name': 'volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087760ae-e41d-4e8c-ae82-9feda4943a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087760ae-e41d-4e8c-ae82-9feda4943a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340e953-3f39-4299-b51d-31eec1636f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Volume ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'volume_size': 1} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:59 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.620s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-432432558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:18:59Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Creating volume ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:18:59 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:18:59 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 1073741824 Apr 28 15:18:59 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4c63c4-55d3-4959-8e45-2796d5d0c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db064933-5c5f-4ef7-ab21-35bce2702d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:18:59 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Volume volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 (30d7bc29-a5bf-4fa3-b0a0-77b986d63585): created successfully Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db064933-5c5f-4ef7-ab21-35bce2702d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:18:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Flow 'volume_create_manager' (2dd5eaca-d0fa-4603-981d-7fc74cd3a44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:18:59 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-825eea11-1b4a-4c0e-930d-1fa979f693d1 tempest-GroupsV314Test-1968689586 None] Created volume successfully. Apr 28 15:19:00 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-139fb156-cb3b-495b-9900-de06ea7e7607" returned: 0 in 0.621s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-quobyte-139fb156-cb3b-495b-9900-de06ea7e7607" released by "delete_volume" :: held 1.598s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Created reservations ['f5cabd79-09e4-4f66-bdca-9444e1b7c699', 'e6ad0235-2423-42ca-92cc-abf00936b85f', 'e4bab4ab-9a68-4720-a90e-f33cba42388c', 'd3ef5c41-b554-42a6-a3e5-367e2253094b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:00 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:00 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:00 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 1073741824" returned: 0 in 0.919s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:00 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:00 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:00 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.688s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Deleted volume successfully. Apr 28 15:19:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5282579-61bb-4164-9cb3-085f57d90605 tempest-SnapshotsActionsTest-344484377 None] Lock "cinder-139fb156-cb3b-495b-9900-de06ea7e7607-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:01 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.694s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.103s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:01 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Cloning volume 30d7bc29-a5bf-4fa3-b0a0-77b986d63585 to volume 396ff41a-d537-42be-ac8f-b60bfb0ccb9b Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340e953-3f39-4299-b51d-31eec1636f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b4ba6-cb07-4f43-aad9-fc8145342840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Volume volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 (ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5): created successfully Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b4ba6-cb07-4f43-aad9-fc8145342840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (13ad4525-7e3e-4233-8cba-f4f32bb6861d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Creating offline snapshot 709a7d30-1c76-4954-b2d5-73de992a1c62 of volume 30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e4de39-abc6-43a9-b5f8-4b02dc6bb2f9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-dc0c0e5c-80ea-4e60-bda2-46fd8dee5733 tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:19:01 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:01 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:02 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.787s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:02 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 1G Apr 28 15:19:02 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (3724031a-227f-4488-a21f-dff565192ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2031c7-ff1e-4c01-92a4-a1c3ec3f057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2031c7-ff1e-4c01-92a4-a1c3ec3f057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1684098051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbb2b3c-1235-4159-ac7f-a3d6f8d46399,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:03Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99075b11-c853-49a0-861e-731634f5a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99075b11-c853-49a0-861e-731634f5a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7895d202-d9fb-4bc9-bcad-cd835d24aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7895d202-d9fb-4bc9-bcad-cd835d24aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cdbb2b3c-1235-4159-ac7f-a3d6f8d46399', 'volume_name': 'volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399', 'volume_size': 1, 'source_volid': 'ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2912321-2a3d-4ee7-ad61-1a43660558f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2912321-2a3d-4ee7-ad61-1a43660558f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f353e-8b16-41a4-b738-931d1d9e653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Volume cdbb2b3c-1235-4159-ac7f-a3d6f8d46399: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399', 'volume_size': 1, 'source_volid': 'ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'source_volstatus': 'available'} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:03 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 1G" returned: 0 in 0.960s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:03 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:03 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:04 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.683s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:04 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:19:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:04 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:04 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:04 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.621s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:04 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info Apr 28 15:19:04 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:05 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info" returned: 0 in 0.651s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:05 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:19:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:05 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info Apr 28 15:19:05 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:06 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.info" returned: 0 in 0.687s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Acquiring lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] snapshot: 709a7d30-1c76-4954-b2d5-73de992a1c62, volume: 396ff41a-d537-42be-ac8f-b60bfb0ccb9b, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Flow 'volume_create_manager' (c5a9bac1-4628-411a-a628-bef7bd41c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c9410b-01dc-4c24-a755-154c807c4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba785f-75e2-41ba-8b1b-bb21e8c583ee]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c9410b-01dc-4c24-a755-154c807c4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-484118954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72e1141-a00f-4ac1-bace-c3613a356238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa01e2195f04cc997152c43971becc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:06Z,use_quota=True,user_id='c45d32be395a41d0a3f0ef875e49eca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a988742-5ddb-4b94-9931-ff07d9c458cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a988742-5ddb-4b94-9931-ff07d9c458cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1e621f-65ce-4d1c-b913-4814bcca9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1e621f-65ce-4d1c-b913-4814bcca9549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72e1141-a00f-4ac1-bace-c3613a356238', 'volume_name': 'volume-c72e1141-a00f-4ac1-bace-c3613a356238', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254b322b-b43d-4d6e-a068-dc20b8ff9e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254b322b-b43d-4d6e-a068-dc20b8ff9e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd123fd-c259-4da2-9a71-799cbe55cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:06 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Volume c72e1141-a00f-4ac1-bace-c3613a356238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72e1141-a00f-4ac1-bace-c3613a356238', 'volume_size': 1} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:06 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:06 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:06 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.797s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706a011-6f69-415f-9311-bb6426c55692]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:07 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:07 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:07 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.794s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:07 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:19:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:07 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b Apr 28 15:19:07 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:12 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" returned: 0 in 4.532s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2ff31-f5a2-4203-8807-7b3f382774aa]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:12 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:12 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:13 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.875s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:19:13 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Converted 1024.00 MB image at 225.89 MB/s Apr 28 15:19:13 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b is being set with open permissions: ugo+rw: NotImplementedError Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:13 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b Apr 28 15:19:13 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:13 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" returned: 0 in 0.581s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" released by "_copy_volume_from_snapshot" :: held 7.695s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Acquiring lock "cinder-quobyte-709a7d30-1c76-4954-b2d5-73de992a1c62" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-709a7d30-1c76-4954-b2d5-73de992a1c62" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Deleting offline snapshot 709a7d30-1c76-4954-b2d5-73de992a1c62 of volume 30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] snapshot_file for this snap is: volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c0c154-575a-4edc-afe6-80d756b03739]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:13 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:13 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:14 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.693s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:19:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b1e78-a2b6-47ef-bbf9-e15747ba5090]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:14 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:14 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:15 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.696s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:15 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:15 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:15 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.702s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:15 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62 Apr 28 15:19:15 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=81,cinder:INSERT=23,cinder:UPDATE=97,cinder:DELETE=5 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:19:16 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585.709a7d30-1c76-4954-b2d5-73de992a1c62" returned: 0 in 0.583s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-709a7d30-1c76-4954-b2d5-73de992a1c62" released by "_delete_snapshot" :: held 2.762s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.076s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.278s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:16 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Cloning volume ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 to volume cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Creating offline snapshot 566c8439-2a89-4c26-8afa-4b29d04867f9 of volume ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec4cda-776e-4492-a814-2bdf7d26378f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-91702afb-db1d-4073-93a6-6f3110c1ae21 tempest-GroupsV314Test-1968689586 None] Create group from source-group-cf130cfa-e3eb-425b-8234-93c04b807ef8 completed successfully. Apr 28 15:19:16 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:16 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:17 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.728s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:17 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 1G Apr 28 15:19:17 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Acquiring lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf49eda5-70ca-417d-9327-ca738dcd1900]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:17 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b Apr 28 15:19:17 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:18 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 1G" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:18 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:18 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:18 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" returned: 0 in 0.725s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:18 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b Apr 28 15:19:18 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:18 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.695s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:18 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 is being set with open permissions: ugo+rw Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:18 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:18 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:18 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" returned: 0 in 0.639s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-396ff41a-d537-42be-ac8f-b60bfb0ccb9b" released by "delete_volume" :: held 1.416s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Created reservations ['3d97b4e3-38bb-48d7-b314-7397b9c09b6b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:19 devstack cinder-volume[84270]: WARNING cinder.quota [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1280896116 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1280896116, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:19:19 devstack cinder-volume[84270]: WARNING cinder.quota [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1280896116 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1280896116, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Created reservations ['d136e317-97b4-48a7-a0b9-d217cef752ca', '701bc7d9-d68a-4648-b238-d6f63619a289', '1296d6d4-f51a-4284-bc9e-a4f35d16171a', '39b4beb2-3845-409d-8992-56308e98962a'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:19 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:19 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:19 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:19 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info Apr 28 15:19:19 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:19 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.626s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:19 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d86a1380-18af-456b-a1a2-3dd83c2c9f7d tempest-GroupsV314Test-1968689586 None] Delete group completed successfully. Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Acquiring lock "cinder-quobyte-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b52b798-8a0d-44db-a99d-1caf4672de83]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:20 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info" returned: 0 in 0.658s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:20 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info is being set with open permissions: ugo+rw Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:20 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:20 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:20 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info Apr 28 15:19:20 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:20 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.info" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] snapshot: 566c8439-2a89-4c26-8afa-4b29d04867f9, volume: cdbb2b3c-1235-4159-ac7f-a3d6f8d46399, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:20 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.755s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f90254-c5c9-4dce-88a1-99f2b72edb81]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:20 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585 Apr 28 15:19:20 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:20 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:20 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:21 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Lock "cinder-quobyte-30d7bc29-a5bf-4fa3-b0a0-77b986d63585" released by "delete_volume" :: held 1.420s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Created reservations ['0402a735-8069-4b3d-9223-387094561e65'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Created reservations ['58907fb3-c572-4251-af4c-acabee80b8cb', 'fdd9cbf0-4c26-4b3f-b382-6bea07660d02', '31a02c36-9aae-41d9-97f7-69b5992f9453', '196c87f8-4c0b-4a03-b746-9c0624130de1'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:21 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.757s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70be39-a3f9-412e-8fd4-18b2dc4930b8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:21 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:21 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:21 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:21 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:22 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:22 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c8bcc690-39aa-4236-9fa4-c1cbea20dd62 tempest-GroupsV314Test-1968689586 None] Delete group completed successfully. Apr 28 15:19:22 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.812s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:22 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:19:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:22 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 Apr 28 15:19:22 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:27 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" returned: 0 in 5.265s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:27 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f397a09e-0485-4c0f-bd85-a56685923537]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:27 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:27 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:28 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.901s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:28 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:19:28 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Converted 1024.00 MB image at 194.43 MB/s Apr 28 15:19:28 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 is being set with open permissions: ugo+rw Apr 28 15:19:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:28 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 Apr 28 15:19:28 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:29 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" returned: 0 in 0.614s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" released by "_copy_volume_from_snapshot" :: held 8.450s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-566c8439-2a89-4c26-8afa-4b29d04867f9" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-566c8439-2a89-4c26-8afa-4b29d04867f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Deleting offline snapshot 566c8439-2a89-4c26-8afa-4b29d04867f9 of volume ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] snapshot_file for this snap is: volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4306e5b-fc1a-4c8d-ab07-4cf5dd86b59e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:29 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:29 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:30 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.745s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422b376-6c8e-4285-93b4-6d3a643ac05a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:30 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:30 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:30 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.790s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:30 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:30 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:31 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.787s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:31 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=97,cinder:INSERT=33,cinder:UPDATE=111,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:19:31 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9 Apr 28 15:19:31 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:32 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5.566c8439-2a89-4c26-8afa-4b29d04867f9" returned: 0 in 0.622s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-566c8439-2a89-4c26-8afa-4b29d04867f9" released by "_delete_snapshot" :: held 3.055s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.802s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.184s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-484118954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72e1141-a00f-4ac1-bace-c3613a356238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa01e2195f04cc997152c43971becc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:06Z,use_quota=True,user_id='c45d32be395a41d0a3f0ef875e49eca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Creating volume c72e1141-a00f-4ac1-bace-c3613a356238 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:32 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f353e-8b16-41a4-b738-931d1d9e653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399', 'volume_size': 1, 'source_volid': 'ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:32 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 1073741824 Apr 28 15:19:32 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d37ed-a04d-406d-8ec9-ce06d3b39db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Volume volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 (cdbb2b3c-1235-4159-ac7f-a3d6f8d46399): created successfully Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d37ed-a04d-406d-8ec9-ce06d3b39db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (3724031a-227f-4488-a21f-dff565192ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fd7830d3-321f-4d0e-936e-aa080b4b067f tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:19:33 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 1073741824" returned: 0 in 0.828s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:33 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 Apr 28 15:19:33 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:33 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd123fd-c259-4da2-9a71-799cbe55cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72e1141-a00f-4ac1-bace-c3613a356238', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480621c2-3757-4fa3-81a8-ca6b0ae24a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:33 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Volume volume-c72e1141-a00f-4ac1-bace-c3613a356238 (c72e1141-a00f-4ac1-bace-c3613a356238): created successfully Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480621c2-3757-4fa3-81a8-ca6b0ae24a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Flow 'volume_create_manager' (c5a9bac1-4628-411a-a628-bef7bd41c757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:33 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5bf1920e-7712-4725-8e4f-5969392275cc tempest-VolumeQuotasNegativeTestJSON-56346665 None] Created volume successfully. Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (af7a6f89-1437-4c1b-a740-40b8d8449601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff482bb9-fa14-46e7-9765-e50c0d2928ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff482bb9-fa14-46e7-9765-e50c0d2928ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741732163',display_name='tempest-VolumesGetTest-Volume-8686067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b82092-a130-4873-ada4-83285730cba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:34Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8753b29-2c74-4581-a64b-3e814461da72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8753b29-2c74-4581-a64b-3e814461da72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d56467-4ce8-4a98-bf09-2c42f8d9596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d56467-4ce8-4a98-bf09-2c42f8d9596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b82092-a130-4873-ada4-83285730cba7', 'volume_name': 'volume-30b82092-a130-4873-ada4-83285730cba7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7e7163-a993-4748-bdad-2c7d001dac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7e7163-a993-4748-bdad-2c7d001dac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc10ab2-8e97-41bc-b10f-83c5e6155f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:34 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Volume 30b82092-a130-4873-ada4-83285730cba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b82092-a130-4873-ada4-83285730cba7', 'volume_size': 1} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741732163',display_name='tempest-VolumesGetTest-Volume-8686067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b82092-a130-4873-ada4-83285730cba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:34Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Creating volume 30b82092-a130-4873-ada4-83285730cba7 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:34 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:34 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 1073741824 Apr 28 15:19:34 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:35 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 1073741824" returned: 0 in 0.841s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:35 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 Apr 28 15:19:35 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Acquiring lock "cinder-c72e1141-a00f-4ac1-bace-c3613a356238-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "cinder-c72e1141-a00f-4ac1-bace-c3613a356238-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Acquiring lock "cinder-quobyte-c72e1141-a00f-4ac1-bace-c3613a356238" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "cinder-quobyte-c72e1141-a00f-4ac1-bace-c3613a356238" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcc855a-1d2c-40eb-9b23-dad3c32304c0]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:35 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 Apr 28 15:19:35 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:35 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7" returned: 0 in 0.681s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc10ab2-8e97-41bc-b10f-83c5e6155f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b82092-a130-4873-ada4-83285730cba7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a41b8-9d6e-40c9-8a06-42289f0671f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Volume volume-30b82092-a130-4873-ada4-83285730cba7 (30b82092-a130-4873-ada4-83285730cba7): created successfully Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a41b8-9d6e-40c9-8a06-42289f0671f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (af7a6f89-1437-4c1b-a740-40b8d8449601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7a78974e-7f22-4c76-a91d-ea2e6f82929f tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:19:36 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238" returned: 0 in 0.809s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:36 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238 Apr 28 15:19:36 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-30b82092-a130-4873-ada4-83285730cba7-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "cinder-30b82092-a130-4873-ada4-83285730cba7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-30b82092-a130-4873-ada4-83285730cba7" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-30b82092-a130-4873-ada4-83285730cba7" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ccb1b9-7f21-4d87-a72f-3f6830f42568]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:36 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 Apr 28 15:19:36 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:37 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c72e1141-a00f-4ac1-bace-c3613a356238" returned: 0 in 0.704s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "cinder-quobyte-c72e1141-a00f-4ac1-bace-c3613a356238" released by "delete_volume" :: held 1.571s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Created reservations ['43a14732-c196-4b41-b097-a482eeadfcd0', '65a2c0a0-3b3c-4e51-90f0-ba94a1eb028d', '3dbdcdb4-901e-4a2b-befc-d2b7984cb3dd', '403c46c7-2766-46b3-890b-549048491d39'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:37 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:37 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:37 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7" returned: 0 in 0.813s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:37 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7 Apr 28 15:19:37 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:38 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.781s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Deleted volume successfully. Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6ffdd51-9d2e-4adb-bd28-21eb1106d497 tempest-VolumeQuotasNegativeTestJSON-56346665 None] Lock "cinder-c72e1141-a00f-4ac1-bace-c3613a356238-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:38 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-30b82092-a130-4873-ada4-83285730cba7" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-30b82092-a130-4873-ada4-83285730cba7" released by "delete_volume" :: held 1.599s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Created reservations ['651dfa96-79fa-443b-a1a3-c78476a2c513', '7f74eeb1-2748-4c95-bf85-06e3bdd5e114', '238a2b9e-b57d-4479-b4f1-c8904ff4e673', 'a95cbca9-966c-46a6-97aa-587633e7de54'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:38 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:38 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "cinder-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e003d-28d5-45fd-ba43-1a949003c3f9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:39 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.798s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:39 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:19:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-07624359-6f9a-4359-b6c7-f354e5f0bcc5 tempest-VolumesGetTest-459901914 None] Lock "cinder-30b82092-a130-4873-ada4-83285730cba7-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:39 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 Apr 28 15:19:39 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:40 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" returned: 0 in 0.927s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:40 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399 Apr 28 15:19:40 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:40 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" returned: 0 in 0.640s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399" released by "delete_volume" :: held 1.636s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Created reservations ['27cc85e9-5831-4ebf-a024-f26ace4f5df5', '84b0371f-ff59-4fe2-abdf-bd147c0e602c', '5e04f4f4-5e97-457e-b656-7b4c5cf869d7', '6ea2b846-fe57-4aa3-bf3e-6033510ac664'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:40 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:40 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "cinder-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" acquired by "delete_volume" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0068134-3a3c-4372-b519-d7f31c9f6d31]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:41 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.742s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:41 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:41 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:19:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71091eeb-1ff3-4598-9c45-a455e3e67a5d tempest-VolumesGetTest-459901914 None] Lock "cinder-cdbb2b3c-1235-4159-ac7f-a3d6f8d46399-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:42 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.826s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:42 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5 Apr 28 15:19:42 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Flow 'volume_create_manager' (c35340f6-0ac6-4f16-af20-d416f4630fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d728a3d5-b837-4f84-9478-9601f7110968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d728a3d5-b837-4f84-9478-9601f7110968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2034444486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c67e95-2ef2-479d-913b-e9cebd6d9de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce0d51ea864cbc95d7f2908495e7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:42Z,use_quota=True,user_id='6604c30a13024675a320a229553778d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc04a6f8-1e41-402c-8c1e-87a934ce584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc04a6f8-1e41-402c-8c1e-87a934ce584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83967936-5104-481f-8e01-7b0186e50369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83967936-5104-481f-8e01-7b0186e50369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c67e95-2ef2-479d-913b-e9cebd6d9de1', 'volume_name': 'volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dd96fb-59b6-4d6b-87a2-307950cccec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dd96fb-59b6-4d6b-87a2-307950cccec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb2ea49-1ac6-4f6d-ab8f-ab6fa5b94b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:42 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Volume 03c67e95-2ef2-479d-913b-e9cebd6d9de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1', 'volume_size': 1} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2034444486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c67e95-2ef2-479d-913b-e9cebd6d9de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce0d51ea864cbc95d7f2908495e7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:42Z,use_quota=True,user_id='6604c30a13024675a320a229553778d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Creating volume 03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:42 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:42 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 1073741824 Apr 28 15:19:42 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:42 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" returned: 0 in 0.626s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5" released by "delete_volume" :: held 1.547s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Created reservations ['194a2177-3bf3-4a39-b0e3-7ee343e02623', '60b790bf-0637-4a65-af74-7a9d99f2701d', '1c9cb939-34ae-4a3f-b10f-501a76699796', '59b0593b-1cf9-490d-b26f-c43b105609dd'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:43 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:43 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:43 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 1073741824" returned: 0 in 0.867s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:43 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 Apr 28 15:19:43 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:43 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.667s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:19:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-625cca58-b587-44f3-8c79-74b2120821ad tempest-VolumesGetTest-459901914 None] Lock "cinder-ec3db4cc-f3f9-4d0b-9bdf-503b48d52da5-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:44 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1" returned: 0 in 0.682s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb2ea49-1ac6-4f6d-ab8f-ab6fa5b94b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333e37f-ee85-4be5-8b4a-3756514c634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Volume volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 (03c67e95-2ef2-479d-913b-e9cebd6d9de1): created successfully Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333e37f-ee85-4be5-8b4a-3756514c634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Flow 'volume_create_manager' (c35340f6-0ac6-4f16-af20-d416f4630fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-71102d12-4b67-41f4-86db-3a0928f78e6b tempest-SnapshotMetadataTestJSON-1894947854 None] Created volume successfully. Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Flow 'volume_create_manager' (3b10a1e1-7241-40a6-9d24-5cce0cb4ab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d4fe43-f765-461a-b8cf-e944373f130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d4fe43-f765-461a-b8cf-e944373f130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-957536730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3b6af-9981-4f4f-b6b9-51a82f2d4c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4d03a717ce43f1b752467c28e70723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:44Z,use_quota=True,user_id='461bd7fd01a4457e9dd48818f973089a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9166bb-5210-4239-8589-9a488eb0bc65),volume_type_id=3d9166bb-5210-4239-8589-9a488eb0bc65)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd21907-26bd-4342-a60f-562384fe03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd21907-26bd-4342-a60f-562384fe03d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4fe750-c676-4e2e-87b2-9f1fdf12e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4fe750-c676-4e2e-87b2-9f1fdf12e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e3b6af-9981-4f4f-b6b9-51a82f2d4c78', 'volume_name': 'volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ef5601-b85a-44ef-a257-10b70407cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ef5601-b85a-44ef-a257-10b70407cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875f41f-f19c-4583-bf67-49ec78239e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Volume 03e3b6af-9981-4f4f-b6b9-51a82f2d4c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78', 'volume_size': 1} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-957536730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3b6af-9981-4f4f-b6b9-51a82f2d4c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4d03a717ce43f1b752467c28e70723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:44Z,use_quota=True,user_id='461bd7fd01a4457e9dd48818f973089a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9166bb-5210-4239-8589-9a488eb0bc65),volume_type_id=3d9166bb-5210-4239-8589-9a488eb0bc65)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Creating volume 03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:44 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:44 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 1073741824 Apr 28 15:19:44 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (1e3a83f8-0818-4a2a-b311-8f0540f0597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926515c7-3b7c-4365-98ab-1dd2c32567dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926515c7-3b7c-4365-98ab-1dd2c32567dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1692666180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de30f13-cdfa-463b-bf53-49a8984c964b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:44Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d65415-922d-401d-80f7-719cd2a9c94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d65415-922d-401d-80f7-719cd2a9c94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07f01f-edeb-4839-8a02-c13decef1e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.image.glance [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Creating Keystone auth plugin from conf {{(pid=84270) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07f01f-edeb-4839-8a02-c13decef1e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2de30f13-cdfa-463b-bf53-49a8984c964b', 'volume_name': 'volume-2de30f13-cdfa-463b-bf53-49a8984c964b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df40f687-b60c-411e-880b-c1e091e0df5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df40f687-b60c-411e-880b-c1e091e0df5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819cab76-08b5-423b-8d46-c7a415c86131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Volume 2de30f13-cdfa-463b-bf53-49a8984c964b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2de30f13-cdfa-463b-bf53-49a8984c964b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 15:19:44 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Trying to clone 2de30f13-cdfa-463b-bf53-49a8984c964b from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]). {{(pid=84270) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 15:19:45 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 1073741824" returned: 0 in 0.786s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:45 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 Apr 28 15:19:45 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 15:19:45 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Image download 20.69 MB at 20.69 MB/s Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2a457-9b68-426d-a711-80353f7fcd30]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:45 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD Apr 28 15:19:45 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:45 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" returned: 0 in 0.648s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Creating offline snapshot d13381db-5049-4984-b960-9bc0e40c083d of volume 03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875f41f-f19c-4583-bf67-49ec78239e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286bcc8e-33ab-4bbf-89bc-791365b74edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f05dcb2-7e8a-4b8e-9eae-bb4d4dd282ee]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:45 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Volume volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 (03e3b6af-9981-4f4f-b6b9-51a82f2d4c78): created successfully Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286bcc8e-33ab-4bbf-89bc-791365b74edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:45 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Flow 'volume_create_manager' (3b10a1e1-7241-40a6-9d24-5cce0cb4ab9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:45 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-df5747b8-c9bf-4da6-ac35-694f73bfe575 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Created volume successfully. Apr 28 15:19:45 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 Apr 28 15:19:45 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:46 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e is fetched for user ca3d84590bb24a00840bbc2681e0d768. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fbf6e3-d614-49d8-a932-a116fe185a59]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:46 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD Apr 28 15:19:46 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:46 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1" returned: 0 in 0.787s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:46 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d 1G Apr 28 15:19:46 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:46 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:46 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:46 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:47 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.654s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:47 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:47 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:47 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1a506ce9-ac64-44a3-aeb2-a85c619ea9ce tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Retype volume completed successfully. Apr 28 15:19:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d 1G" returned: 0 in 0.790s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:47 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d Apr 28 15:19:47 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "cinder-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "cinder-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "cinder-quobyte-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "cinder-quobyte-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:48 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d" returned: 0 in 0.677s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:48 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d is being set with open permissions: ugo+rw Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62ce3c0-8907-4262-b7ae-ae14a3f731b2]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:48 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d Apr 28 15:19:48 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:48 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 Apr 28 15:19:48 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:48 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d" returned: 0 in 0.595s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:48 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info Apr 28 15:19:48 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:48 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" returned: 0 in 0.778s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:48 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78 Apr 28 15:19:48 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:49 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info" returned: 0 in 0.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:49 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info is being set with open permissions: ugo+rw Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:49 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info Apr 28 15:19:49 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:49 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" returned: 0 in 0.625s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "cinder-quobyte-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78" released by "delete_volume" :: held 1.450s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:49 devstack cinder-volume[84270]: WARNING cinder.quota [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:19:49 devstack cinder-volume[84270]: WARNING cinder.quota [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Created reservations ['26bd8c43-3417-4087-90af-b638f98c2e60', '6b794b46-beaf-4aed-8355-cee33fb8a08e', '9306a9d3-2aee-4cca-b171-4c8cbc7f8a1e', '852003af-af77-4662-b29a-132546f8f3ba'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:49 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:49 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:49 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.info" returned: 0 in 0.598s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1692666180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de30f13-cdfa-463b-bf53-49a8984c964b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:44Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Creating volume 2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:49 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:50 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1073741824 Apr 28 15:19:50 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-eaf58185-8991-4f6f-8676-8e9acd79f787 tempest-SnapshotMetadataTestJSON-1894947854 None] Create snapshot completed successfully Apr 28 15:19:50 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.634s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Deleted volume successfully. Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-63c06e09-462a-4124-8982-8fe0d3121476 tempest-VolumeRetypeWithoutMigrationTest-1251287268 None] Lock "cinder-03e3b6af-9981-4f4f-b6b9-51a82f2d4c78-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:50 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:50 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:50 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1073741824" returned: 0 in 0.819s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:50 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:19:50 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:51 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.731s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:51 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 0 in 0.756s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Attempting download of e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 2de30f13-cdfa-463b-bf53-49a8984c964b. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62641c0-6fd5-40af-bae9-2c308368e7b7]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "cinder-d13381db-5049-4984-b960-9bc0e40c083d-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:51 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv Apr 28 15:19:51 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-d13381db-5049-4984-b960-9bc0e40c083d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "cinder-quobyte-d13381db-5049-4984-b960-9bc0e40c083d" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-d13381db-5049-4984-b960-9bc0e40c083d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Deleting offline snapshot d13381db-5049-4984-b960-9bc0e40c083d of volume 03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] snapshot_file for this snap is: volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c98f8-2142-48fb-a877-0ee6235fdba8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:52 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d Apr 28 15:19:52 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:52 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv" returned: 0 in 0.747s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:52 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv Apr 28 15:19:52 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:52 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d" returned: 0 in 0.806s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c09df-680b-47c9-a68e-2249d921d10a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:52 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 Apr 28 15:19:52 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:53 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv" returned: 1 in 0.729s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_kzbylpfv' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8602ef0-ac85-4ecd-a64c-ad06e9cc1160]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:53 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD Apr 28 15:19:53 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:53 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1" returned: 0 in 0.785s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:53 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d Apr 28 15:19:53 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:53 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD" returned: 0 in 0.691s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e was qcow2, converting to raw {{(pid=84270) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 15:19:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:53 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:19:53 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:54 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d" returned: 0 in 0.779s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:54 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d Apr 28 15:19:54 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:55 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1.d13381db-5049-4984-b960-9bc0e40c083d" returned: 0 in 0.664s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-d13381db-5049-4984-b960-9bc0e40c083d" released by "_delete_snapshot" :: held 3.171s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" released by "delete_snapshot" :: held 3.193s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Created reservations ['85761c70-8c7e-449b-9be4-d12f7b2872f4', '66f9a297-3943-4476-95b8-8ba02cd9961a', 'ff5cad1c-277e-40c7-89eb-60162902f524', '01dd94db-1ba4-4b1f-807e-bba9da1fb685'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Delete snapshot completed successfully. Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-49976726-28ff-40e0-b5b3-a8c0f0b569ce tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-d13381db-5049-4984-b960-9bc0e40c083d-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:55 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 0 in 2.049s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rm2egumdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:19:55 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Converted 112.00 MB image at 54.65 MB/s Apr 28 15:19:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:55 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1G Apr 28 15:19:55 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Flow 'volume_create_manager' (59dd6eeb-b528-41af-bf50-bbe8c4888981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abc8289-4b65-4c72-95de-01c122b8e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abc8289-4b65-4c72-95de-01c122b8e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1122124319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a569d89-c055-4e4f-b743-85bbdb7ff3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e3fced04d44d498d4fecd8c2b8208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:56Z,use_quota=True,user_id='b11297aec8aa4f51be3fab04f2d44c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0534abcb-61a4-46bd-a94e-2589cd11216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0534abcb-61a4-46bd-a94e-2589cd11216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f46bf2-1442-4f04-ba99-e32a37b35b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f46bf2-1442-4f04-ba99-e32a37b35b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a569d89-c055-4e4f-b743-85bbdb7ff3d3', 'volume_name': 'volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b71bd-8a69-4ddb-b214-95b3f0a17b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b71bd-8a69-4ddb-b214-95b3f0a17b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8a369-d250-4ed9-9543-f0843e3fd127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:56 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Volume 4a569d89-c055-4e4f-b743-85bbdb7ff3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3', 'volume_size': 1} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1122124319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a569d89-c055-4e4f-b743-85bbdb7ff3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e3fced04d44d498d4fecd8c2b8208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:56Z,use_quota=True,user_id='b11297aec8aa4f51be3fab04f2d44c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Creating volume 4a569d89-c055-4e4f-b743-85bbdb7ff3d3 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:56 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "cinder-03c67e95-2ef2-479d-913b-e9cebd6d9de1-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:56 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 1073741824 Apr 28 15:19:56 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-03c67e95-2ef2-479d-913b-e9cebd6d9de1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c44d760-f496-427d-bd7e-3dc0914bf241]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:56 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 Apr 28 15:19:56 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:56 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b 1G" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dbe936-61c4-4b11-95ee-631237964425]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:56 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:19:56 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:57 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 1073741824" returned: 0 in 0.870s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:57 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:57 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1 Apr 28 15:19:57 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:57 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 Apr 28 15:19:57 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:57 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 0 in 0.796s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:57 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:19:57 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:57 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" returned: 0 in 0.613s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:57 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-03c67e95-2ef2-479d-913b-e9cebd6d9de1" returned: 0 in 0.657s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8a369-d250-4ed9-9543-f0843e3fd127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e46bc9c-20a9-4af0-9873-d9c5cad8ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-quobyte-03c67e95-2ef2-479d-913b-e9cebd6d9de1" released by "delete_volume" :: held 1.461s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:57 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Volume volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 (4a569d89-c055-4e4f-b743-85bbdb7ff3d3): created successfully Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e46bc9c-20a9-4af0-9873-d9c5cad8ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Flow 'volume_create_manager' (59dd6eeb-b528-41af-bf50-bbe8c4888981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:57 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d7050b2f-6460-451d-b1d7-7511e12d05c3 tempest-VolumesServicesTestJSON-2141326828 None] Created volume successfully. Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Created reservations ['fdc37141-1296-414e-9b3d-ac44d0f5199c', '46ae48b9-7e31-4583-9b53-2d06ef88b603', 'd59043ae-9d41-42d2-9197-049e6c6f03a4', '36ce6dab-d365-47af-ba53-76aa0ce8667f'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:57 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:19:57 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:58 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 1 in 0.745s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Downloaded image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 2de30f13-cdfa-463b-bf53-49a8984c964b successfully. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e for user ca3d84590bb24a00840bbc2681e0d768 is deleted. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Marking volume 2de30f13-cdfa-463b-bf53-49a8984c964b as bootable. {{(pid=84270) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Copying metadata from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e to 2de30f13-cdfa-463b-bf53-49a8984c964b. {{(pid=84270) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Creating volume glance metadata for volume 2de30f13-cdfa-463b-bf53-49a8984c964b backed by image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84270) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Acquiring lock "cinder-4a569d89-c055-4e4f-b743-85bbdb7ff3d3-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819cab76-08b5-423b-8d46-c7a415c86131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de30f13-cdfa-463b-bf53-49a8984c964b', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa3fe58-ca8b-4ef1-a89c-0f92b2cf8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "cinder-4a569d89-c055-4e4f-b743-85bbdb7ff3d3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:58 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Volume volume-2de30f13-cdfa-463b-bf53-49a8984c964b (2de30f13-cdfa-463b-bf53-49a8984c964b): created successfully Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa3fe58-ca8b-4ef1-a89c-0f92b2cf8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (1e3a83f8-0818-4a2a-b311-8f0540f0597d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:58 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a30a50fb-3e41-4169-aa9d-922596d8bfb4 tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Acquiring lock "cinder-quobyte-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "cinder-quobyte-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf627a2d-b874-44cd-8244-4186bbcefa4c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:58 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.679s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:19:58 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Deleted volume successfully. Apr 28 15:19:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-69eeadae-0648-471b-9498-dcf78e86b6bc tempest-SnapshotMetadataTestJSON-1894947854 None] Lock "cinder-03c67e95-2ef2-479d-913b-e9cebd6d9de1-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:19:58 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 Apr 28 15:19:58 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (73598518-3c85-4c3a-a2b8-775f5d88b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cecba54-bce3-455a-8606-c3553b39980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:59 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" returned: 0 in 0.835s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cecba54-bce3-455a-8606-c3553b39980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-741545903',display_name='tempest-VolumesGetTest-Volume-1854663284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70135f2-6982-4ac3-b6e5-f80a7483b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:59Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:59 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3 Apr 28 15:19:59 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a6ff1-3cd0-4d41-a79f-44affbc36061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a6ff1-3cd0-4d41-a79f-44affbc36061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bcb1d5-b87b-45bb-8132-209e5fed7f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bcb1d5-b87b-45bb-8132-209e5fed7f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70135f2-6982-4ac3-b6e5-f80a7483b2fd', 'volume_name': 'volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94934549-f767-425c-af83-3bcdd32b3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94934549-f767-425c-af83-3bcdd32b3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e82511-51c9-4082-ac04-19bc6606d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:19:59 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Volume c70135f2-6982-4ac3-b6e5-f80a7483b2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd', 'volume_size': 1} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:19:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-741545903',display_name='tempest-VolumesGetTest-Volume-1854663284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70135f2-6982-4ac3-b6e5-f80a7483b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d0f9389c4247929bef3aafbfefb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:19:59Z,use_quota=True,user_id='ca3d84590bb24a00840bbc2681e0d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Creating volume c70135f2-6982-4ac3-b6e5-f80a7483b2fd {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:19:59 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:19:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:19:59 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd 1073741824 Apr 28 15:19:59 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:00 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "cinder-quobyte-4a569d89-c055-4e4f-b743-85bbdb7ff3d3" released by "delete_volume" :: held 1.600s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Created reservations ['f4576aef-61d8-4fd5-986f-2d9779cdf55d', '00e90b9c-e987-414a-8967-808a252d87d8', '88aafd14-2bcf-42d0-aaed-d128444e6099', '84124f82-7e6e-4256-974e-89d9f5322641'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:00 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:00 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:00 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd 1073741824" returned: 0 in 0.903s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:00 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd Apr 28 15:20:00 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:00 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.756s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Deleted volume successfully. Apr 28 15:20:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ae90143b-94ec-40e6-9bb2-9b0f1f3e3c9c tempest-VolumesServicesTestJSON-2141326828 None] Lock "cinder-4a569d89-c055-4e4f-b743-85bbdb7ff3d3-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:01 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" returned: 0 in 0.690s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e82511-51c9-4082-ac04-19bc6606d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab6d1d-ce06-47fb-b30a-d9a1d8244be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Volume volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd (c70135f2-6982-4ac3-b6e5-f80a7483b2fd): created successfully Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab6d1d-ce06-47fb-b30a-d9a1d8244be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Flow 'volume_create_manager' (73598518-3c85-4c3a-a2b8-775f5d88b515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-07a4e5e3-8dc9-4917-91a2-8ad56a44b24a tempest-VolumesGetTest-459901914 None] Created volume successfully. Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-c70135f2-6982-4ac3-b6e5-f80a7483b2fd-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "cinder-c70135f2-6982-4ac3-b6e5-f80a7483b2fd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" acquired by "delete_volume" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ad1805-6d8b-4f49-949c-78736622cba3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:01 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd Apr 28 15:20:01 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:02 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" returned: 0 in 0.772s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:02 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd Apr 28 15:20:02 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Flow 'volume_create_manager' (073dda58-53bd-45dd-9755-0474a9f11fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc2fe9d-1fc8-4794-80c2-f27f42a47705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc2fe9d-1fc8-4794-80c2-f27f42a47705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-394648806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8018bb3a-3d0d-44f7-b13b-24dd5faef2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f340a0ef617d4c73b2657b4c98b852e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:03Z,use_quota=True,user_id='7bcbd7a3f7bf4dd9a144a03553789aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6573a349-0f3c-4692-ad6f-47cfc004faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6573a349-0f3c-4692-ad6f-47cfc004faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc35ca-f7e3-4981-b253-6e54fea096ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc35ca-f7e3-4981-b253-6e54fea096ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8018bb3a-3d0d-44f7-b13b-24dd5faef2d5', 'volume_name': 'volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6292f248-e85a-47f0-b1ad-fde9ee81b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6292f248-e85a-47f0-b1ad-fde9ee81b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee309c-1819-4aeb-8abc-3558937734c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:02 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Volume 8018bb3a-3d0d-44f7-b13b-24dd5faef2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5', 'volume_size': 1} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-394648806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8018bb3a-3d0d-44f7-b13b-24dd5faef2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f340a0ef617d4c73b2657b4c98b852e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:03Z,use_quota=True,user_id='7bcbd7a3f7bf4dd9a144a03553789aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Creating volume 8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:20:02 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:20:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:02 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 1073741824 Apr 28 15:20:02 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:03 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-c70135f2-6982-4ac3-b6e5-f80a7483b2fd" released by "delete_volume" :: held 1.603s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Created reservations ['c55a0768-8a19-4680-ba48-60dde30ffd41', 'a258f074-3e12-4752-a920-3b79c67192bf', 'aa9af28d-e1f9-412a-9f4b-610568e7b442', 'f6d5b53b-3e72-43f5-a6c7-2c2d063445cb'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:03 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:03 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:03 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 1073741824" returned: 0 in 0.971s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:03 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 Apr 28 15:20:03 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-2de30f13-cdfa-463b-bf53-49a8984c964b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "cinder-2de30f13-cdfa-463b-bf53-49a8984c964b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Acquiring lock "cinder-quobyte-2de30f13-cdfa-463b-bf53-49a8984c964b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-2de30f13-cdfa-463b-bf53-49a8984c964b" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:04 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.743s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dd00e1-9b46-452b-90a0-a164b621c8cf]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-29ed13ab-b0b8-4418-9272-76abf1335297 tempest-VolumesGetTest-459901914 None] Lock "cinder-c70135f2-6982-4ac3-b6e5-f80a7483b2fd-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:04 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:20:04 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:04 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" returned: 0 in 0.658s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee309c-1819-4aeb-8abc-3558937734c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17df9b55-ffbe-4047-bc7c-528c24be321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:04 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Volume volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 (8018bb3a-3d0d-44f7-b13b-24dd5faef2d5): created successfully Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17df9b55-ffbe-4047-bc7c-528c24be321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Flow 'volume_create_manager' (073dda58-53bd-45dd-9755-0474a9f11fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8b4a9e67-023a-4fcc-9a82-8389f7678377 tempest-AbsoluteLimitsTests-2115821031 None] Created volume successfully. Apr 28 15:20:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Acquiring lock "cinder-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "cinder-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:05 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 0 in 0.769s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Acquiring lock "cinder-quobyte-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "cinder-quobyte-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a937614-fef4-40b9-9fbf-cf59fe5555c2]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:05 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:20:05 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:05 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 Apr 28 15:20:05 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:05 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 1 in 0.766s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:05 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b Apr 28 15:20:05 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:05 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" returned: 0 in 0.745s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:05 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5 Apr 28 15:20:05 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:06 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2de30f13-cdfa-463b-bf53-49a8984c964b" returned: 0 in 0.627s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "cinder-quobyte-2de30f13-cdfa-463b-bf53-49a8984c964b" released by "delete_volume" :: held 2.267s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:20:06 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Flow 'volume_create_manager' (2a5b50ac-122a-4214-b873-a3f9b7f76deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37302346-ab94-4ec2-b3cd-941460389ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" returned: 0 in 0.663s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37302346-ab94-4ec2-b3cd-941460389ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1925448388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a102b4c-2f35-424a-b4a2-4f77186224b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6460d3d51894f0aba116590ad9f0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:06Z,use_quota=True,user_id='00e0029fb02a419397310df935ad1cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158d9d4-b7e9-4577-b99d-bf5b7c349e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158d9d4-b7e9-4577-b99d-bf5b7c349e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bebeba8-ade5-47c3-a0b9-e70c39208f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bebeba8-ade5-47c3-a0b9-e70c39208f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a102b4c-2f35-424a-b4a2-4f77186224b1', 'volume_name': 'volume-3a102b4c-2f35-424a-b4a2-4f77186224b1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf223ba8-c4bb-4457-b6b1-51b8caf51010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf223ba8-c4bb-4457-b6b1-51b8caf51010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c3cf0c-aa27-43c2-aea1-db4c12fdae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:06 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Volume 3a102b4c-2f35-424a-b4a2-4f77186224b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a102b4c-2f35-424a-b4a2-4f77186224b1', 'volume_size': 1} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1925448388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a102b4c-2f35-424a-b4a2-4f77186224b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6460d3d51894f0aba116590ad9f0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:06Z,use_quota=True,user_id='00e0029fb02a419397310df935ad1cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Creating volume 3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:20:06 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "cinder-quobyte-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5" released by "delete_volume" :: held 1.512s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:06 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 1073741824 Apr 28 15:20:06 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Created reservations ['d2ccf121-88db-456d-84d6-e6ae3366fb43', '2f34aebe-b02a-4390-b783-41037ecc6b4b', '048ca3a9-1706-4bd1-83d6-1b14eeb4e56c', 'f5f3de39-ba84-4e35-878a-adb2720a7ab0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Created reservations ['d71cfb2a-f847-4371-acce-6bcd5d92e3b2', '6ddca6d6-9337-42d8-8292-2ea0f9334422', '8c7e94e5-30f9-403e-823e-1c34c373b399', '8fc3888a-6924-42b7-b5b6-589fd635f4ba'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:06 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:06 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:06 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:06 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:07 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.642s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Deleted volume successfully. Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e4d39769-ae8f-47cd-a8b1-803e240d14ca tempest-VolumesGetTest-459901914 None] Lock "cinder-2de30f13-cdfa-463b-bf53-49a8984c964b-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:07 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.653s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Deleted volume successfully. Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c556ae0c-6b0b-4fa4-aaf0-752ce4a7f8a2 tempest-AbsoluteLimitsTests-2115821031 None] Lock "cinder-8018bb3a-3d0d-44f7-b13b-24dd5faef2d5-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:07 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 1073741824" returned: 0 in 0.973s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:07 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 Apr 28 15:20:07 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:08 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1" returned: 0 in 0.665s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c3cf0c-aa27-43c2-aea1-db4c12fdae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a102b4c-2f35-424a-b4a2-4f77186224b1', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93622dc3-17f3-46bb-8016-d28abb59f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:08 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Volume volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 (3a102b4c-2f35-424a-b4a2-4f77186224b1): created successfully Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93622dc3-17f3-46bb-8016-d28abb59f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Flow 'volume_create_manager' (2a5b50ac-122a-4214-b873-a3f9b7f76deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-95059c14-79c8-4a81-af69-e8cebda854a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Created volume successfully. Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Creating offline snapshot 68ec2d67-576e-4d2f-8c14-5e2e153e8774 of volume 3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c31ab4d-a62c-41b8-b55a-d1736996d129]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:09 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 Apr 28 15:20:09 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:09 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1" returned: 0 in 0.819s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:09 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 1G Apr 28 15:20:09 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:10 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 1G" returned: 0 in 0.932s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:10 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 Apr 28 15:20:10 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:11 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:11 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 is being set with open permissions: ugo+rw Apr 28 15:20:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:11 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 Apr 28 15:20:11 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:12 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774" returned: 0 in 0.648s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:12 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info Apr 28 15:20:12 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:12 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info" returned: 0 in 0.637s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:12 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info is being set with open permissions: ugo+rw Apr 28 15:20:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:12 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info Apr 28 15:20:12 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:13 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.info" returned: 0 in 0.651s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Flow 'volume_create_manager' (89865f45-cb47-4762-adca-17c4f63ae7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791594a7-3e5d-4768-b797-3b31ef967285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791594a7-3e5d-4768-b797-3b31ef967285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-428003063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc531a2b-3821-4f78-955c-fd8404181dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07d39052a445ac955948bfcc14989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:13Z,use_quota=True,user_id='f2e29b037ea1433899e300d2fe154136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f5357e-7fe4-4abb-ad12-898f1202376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f5357e-7fe4-4abb-ad12-898f1202376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fb0b2e-8ec6-459c-a6fc-76dcd6dce524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fb0b2e-8ec6-459c-a6fc-76dcd6dce524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc531a2b-3821-4f78-955c-fd8404181dbe', 'volume_name': 'volume-bc531a2b-3821-4f78-955c-fd8404181dbe', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b523118-c028-47a0-914f-15a4182b523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b523118-c028-47a0-914f-15a4182b523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce25a8f0-90a8-4618-a186-b322dcee1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:13 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Volume bc531a2b-3821-4f78-955c-fd8404181dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc531a2b-3821-4f78-955c-fd8404181dbe', 'volume_size': 1} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-428003063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc531a2b-3821-4f78-955c-fd8404181dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07d39052a445ac955948bfcc14989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:13Z,use_quota=True,user_id='f2e29b037ea1433899e300d2fe154136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Creating volume bc531a2b-3821-4f78-955c-fd8404181dbe {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:20:13 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:20:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-75b9677b-fa97-40b6-a570-5e8bb3e7cc5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Create snapshot completed successfully Apr 28 15:20:13 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe 1073741824 Apr 28 15:20:13 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:14 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe 1073741824" returned: 0 in 0.900s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:14 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe Apr 28 15:20:14 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "cinder-68ec2d67-576e-4d2f-8c14-5e2e153e8774-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-68ec2d67-576e-4d2f-8c14-5e2e153e8774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "cinder-quobyte-68ec2d67-576e-4d2f-8c14-5e2e153e8774" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-68ec2d67-576e-4d2f-8c14-5e2e153e8774" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Deleting offline snapshot 68ec2d67-576e-4d2f-8c14-5e2e153e8774 of volume 3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] snapshot_file for this snap is: volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf361f-d8fe-4043-acd0-8aa63ea2627a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:14 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 Apr 28 15:20:14 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:15 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe" returned: 0 in 0.636s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce25a8f0-90a8-4618-a186-b322dcee1e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc531a2b-3821-4f78-955c-fd8404181dbe', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b35325-5fa6-4ceb-9d05-5bb9249b53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:15 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Volume volume-bc531a2b-3821-4f78-955c-fd8404181dbe (bc531a2b-3821-4f78-955c-fd8404181dbe): created successfully Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b35325-5fa6-4ceb-9d05-5bb9249b53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Flow 'volume_create_manager' (89865f45-cb47-4762-adca-17c4f63ae7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:15 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3009dd88-85fb-41ca-a8cb-8fa2165be883 tempest-VolumesTransfersV357Test-770227563 None] Created volume successfully. Apr 28 15:20:15 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a102b4c-2f35-424a-b4a2-4f77186224b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7377b-7401-42b8-ac0b-855924ca6412]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:15 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 Apr 28 15:20:15 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:16 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=156,cinder:INSERT=34,cinder:SELECT=132,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:20:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-9a38abf1-2c16-49bb-93b7-54bd299cf37f tempest-VolumesTransfersV357Test-1447618410 None] Transfer volume completed successfully. Apr 28 15:20:16 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1" returned: 0 in 0.734s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:16 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 Apr 28 15:20:16 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:16 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774" returned: 0 in 0.733s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:16 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774 Apr 28 15:20:16 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "cinder-bc531a2b-3821-4f78-955c-fd8404181dbe-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-bc531a2b-3821-4f78-955c-fd8404181dbe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "cinder-quobyte-bc531a2b-3821-4f78-955c-fd8404181dbe" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-quobyte-bc531a2b-3821-4f78-955c-fd8404181dbe" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4854a7-4216-4af7-8076-810d2cadcf03]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:17 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe Apr 28 15:20:17 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:17 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1.68ec2d67-576e-4d2f-8c14-5e2e153e8774" returned: 0 in 0.608s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-68ec2d67-576e-4d2f-8c14-5e2e153e8774" released by "_delete_snapshot" :: held 2.895s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" released by "delete_snapshot" :: held 2.917s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Created reservations ['21d9214a-e66e-40a9-965f-7e30f1eee85a', '43b1db6a-aef6-4944-9627-9d489f84a1ed', 'eff010d0-ccfe-46d7-a03c-cb89a01b34e7', '01f20787-0731-423c-8aa0-5dcd459826b8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Delete snapshot completed successfully. Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-79729a37-9c87-4443-bbd8-e13fbd16e5bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-68ec2d67-576e-4d2f-8c14-5e2e153e8774-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "cinder-3a102b4c-2f35-424a-b4a2-4f77186224b1-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-3a102b4c-2f35-424a-b4a2-4f77186224b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:17 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:18 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe Apr 28 15:20:18 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0a2d78-78a8-4fd1-9bec-37ad3f132c29]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:18 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 Apr 28 15:20:18 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:18 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-bc531a2b-3821-4f78-955c-fd8404181dbe" returned: 0 in 0.592s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-quobyte-bc531a2b-3821-4f78-955c-fd8404181dbe" released by "delete_volume" :: held 1.401s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Created reservations ['8c17be8b-3735-4ce2-bbfd-5f4af2826151', '860c248c-a512-4a3d-adc4-0bc9326ff957', 'c5838ade-e78b-4fd3-b92c-f05104a2ed78', '5cbe1456-425b-4571-9488-025b2e975c6d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:18 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:18 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:18 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1" returned: 0 in 0.781s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:18 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1 Apr 28 15:20:18 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:19 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.634s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Deleted volume successfully. Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-47c992d4-eda9-49a1-b786-bb54759b1942 tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-bc531a2b-3821-4f78-955c-fd8404181dbe-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:19 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3a102b4c-2f35-424a-b4a2-4f77186224b1" returned: 0 in 0.620s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-quobyte-3a102b4c-2f35-424a-b4a2-4f77186224b1" released by "delete_volume" :: held 1.472s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Created reservations ['edf6185a-575e-4721-8ad8-04d04f975eda', 'ad6b7f9e-daeb-4e0f-988f-5e80dcee387d', '87bb8d52-6aff-424e-8500-95f01d5d3c82', '12158b30-84ec-4d99-876e-43784e537203'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:19 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:19 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Flow 'volume_create_manager' (42ca6fa9-f049-42d6-a4d5-f6c59d396a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff4584b-513b-473b-8d83-96e74b22fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff4584b-513b-473b-8d83-96e74b22fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2053090242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c7d140-f0ef-49b3-a1af-ad39ea7982f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07d39052a445ac955948bfcc14989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:20Z,use_quota=True,user_id='f2e29b037ea1433899e300d2fe154136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bce6f08-cce4-4b11-9ea1-91ed533d6496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bce6f08-cce4-4b11-9ea1-91ed533d6496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062eb43b-99d6-41ff-842e-53449123ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062eb43b-99d6-41ff-842e-53449123ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c7d140-f0ef-49b3-a1af-ad39ea7982f6', 'volume_name': 'volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7245e1-fbea-4022-a23a-500cb022e242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7245e1-fbea-4022-a23a-500cb022e242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5746b0-9def-4cb2-a384-a52aa5a62368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:19 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Volume e1c7d140-f0ef-49b3-a1af-ad39ea7982f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6', 'volume_size': 1} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2053090242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c7d140-f0ef-49b3-a1af-ad39ea7982f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07d39052a445ac955948bfcc14989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:20Z,use_quota=True,user_id='f2e29b037ea1433899e300d2fe154136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Creating volume e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:20:19 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:20:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:19 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 1073741824 Apr 28 15:20:19 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:20 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.646s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:20 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Deleted volume successfully. Apr 28 15:20:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-763de6f9-7fc0-4596-8d74-b607e6b18cd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2140216940 None] Lock "cinder-3a102b4c-2f35-424a-b4a2-4f77186224b1-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:20 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 1073741824" returned: 0 in 0.827s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:20 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 Apr 28 15:20:20 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:21 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" returned: 0 in 0.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5746b0-9def-4cb2-a384-a52aa5a62368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223933c-e886-4559-b928-1c5609318c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Volume volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 (e1c7d140-f0ef-49b3-a1af-ad39ea7982f6): created successfully Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223933c-e886-4559-b928-1c5609318c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Flow 'volume_create_manager' (42ca6fa9-f049-42d6-a4d5-f6c59d396a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8abe3098-2ec9-4d19-b742-c400be90cc6f tempest-VolumesTransfersV357Test-770227563 None] Created volume successfully. Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "cinder-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "cinder-quobyte-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-quobyte-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1303b6d8-10d9-4503-acdd-bf95f4773c90]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:20:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:22 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 Apr 28 15:20:22 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:23 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" returned: 0 in 0.734s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:23 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6 Apr 28 15:20:23 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:23 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" returned: 0 in 0.672s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-quobyte-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6" released by "delete_volume" :: held 1.450s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Created reservations ['771d7c69-b7ac-4caa-96f8-99a19ccc7b2e', '2fe0ec6a-5e5d-4951-b481-4c5a8be1c944', '9b2e6cb6-81b9-41f6-b010-5cbe07d7acbd', 'ef2e06a4-07cf-4771-80aa-5f7995ba2657'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:23 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:23 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:24 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.676s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:24 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:20:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Deleted volume successfully. Apr 28 15:20:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1619281c-67ad-40ce-a9fa-3684ed3bffdc tempest-VolumesTransfersV357Test-1839950350 None] Lock "cinder-e1c7d140-f0ef-49b3-a1af-ad39ea7982f6-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:20:33 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:20:34 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=106,cinder:INSERT=51,cinder:UPDATE=158,cinder:DELETE=18 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Flow 'volume_create_manager' (d63891b6-a093-4e6b-b9aa-a820012ba274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a0f26c-5e4b-4a2f-80cd-eaadce878b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a0f26c-5e4b-4a2f-80cd-eaadce878b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1846032098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a9f854-cdfa-4133-b198-2c26ed4bb98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec8efec433547dbb14aefcd1a9bca5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:39Z,use_quota=True,user_id='e19a1368451e4a43b93dea7c4138d48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701ba0d-785f-4c78-bd65-fefa463885b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701ba0d-785f-4c78-bd65-fefa463885b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c46c8-fb4e-4e78-9159-1b823a3de812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c46c8-fb4e-4e78-9159-1b823a3de812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a9f854-cdfa-4133-b198-2c26ed4bb98c', 'volume_name': 'volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86e844f-578f-464e-9ca2-32bb16078211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86e844f-578f-464e-9ca2-32bb16078211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bafeb3e-9b0d-4468-beb9-62f6962cb7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c', 'volume_size': 1} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1846032098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a9f854-cdfa-4133-b198-2c26ed4bb98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec8efec433547dbb14aefcd1a9bca5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:20:39Z,use_quota=True,user_id='e19a1368451e4a43b93dea7c4138d48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Creating volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:20:38 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:20:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:38 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c 1073741824 Apr 28 15:20:38 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:39 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c 1073741824" returned: 0 in 0.820s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:39 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:20:39 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:40 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.625s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bafeb3e-9b0d-4468-beb9-62f6962cb7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78297e74-154b-4879-b00b-bb891623cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:20:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Volume volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c (14a9f854-cdfa-4133-b198-2c26ed4bb98c): created successfully Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78297e74-154b-4879-b00b-bb891623cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:20:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Flow 'volume_create_manager' (d63891b6-a093-4e6b-b9aa-a820012ba274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:20:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-da8e209e-80d7-4616-9460-858719e44946 tempest-VolumesActionsTest-1377479458 None] Created volume successfully. Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:20:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:20:50 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:20:50 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:20:51 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 28 15:20:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.683s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:20:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-14e50e49-a3fa-4e2f-9720-58dd3ececc79 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" by "attach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-14e50e49-a3fa-4e2f-9720-58dd3ececc79 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" acquired by "attach_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-14e50e49-a3fa-4e2f-9720-58dd3ececc79 tempest-VolumesActionsTest-1377479458 None] Attaching volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c to instance 316c1d4a-0a12-4cfa-b685-d18f3d2955b4 at mountpoint /dev/vdb on host None. Apr 28 15:21:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-14e50e49-a3fa-4e2f-9720-58dd3ececc79 tempest-VolumesActionsTest-1377479458 None] Attach volume completed successfully. Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-14e50e49-a3fa-4e2f-9720-58dd3ececc79 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" released by "attach_volume" :: held 0.108s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f9d4b2f3-cf64-405a-9bfc-319d3461c4e9 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" by "detach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f9d4b2f3-cf64-405a-9bfc-319d3461c4e9 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f9d4b2f3-cf64-405a-9bfc-319d3461c4e9 tempest-VolumesActionsTest-1377479458 None] Detaching volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c from instance 316c1d4a-0a12-4cfa-b685-d18f3d2955b4. Apr 28 15:21:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f9d4b2f3-cf64-405a-9bfc-319d3461c4e9 tempest-VolumesActionsTest-1377479458 None] Detach volume completed successfully. Apr 28 15:21:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f9d4b2f3-cf64-405a-9bfc-319d3461c4e9 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (5637ba53-0653-4773-a10e-82e172b46d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a18535-dd21-4776-8741-96e78c3a155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a18535-dd21-4776-8741-96e78c3a155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-818248019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acdc4a5-b01f-411a-bd9f-55211a6bb5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:10Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b89a56-811a-4613-8278-7fcd8ab90fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b89a56-811a-4613-8278-7fcd8ab90fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83be04-0338-4106-9deb-b787a1eb6ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83be04-0338-4106-9deb-b787a1eb6ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0acdc4a5-b01f-411a-bd9f-55211a6bb5fa', 'volume_name': 'volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9b952c-682f-4e69-a250-8a5496fc7fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9b952c-682f-4e69-a250-8a5496fc7fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d527b5-d910-4337-b203-ceb1353db3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:10 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Volume 0acdc4a5-b01f-411a-bd9f-55211a6bb5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa', 'volume_size': 1} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-818248019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acdc4a5-b01f-411a-bd9f-55211a6bb5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:10Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Creating volume 0acdc4a5-b01f-411a-bd9f-55211a6bb5fa {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:21:10 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:21:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:10 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa 1073741824 Apr 28 15:21:10 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:11 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa 1073741824" returned: 0 in 0.810s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:11 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa Apr 28 15:21:11 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:12 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" returned: 0 in 0.667s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d527b5-d910-4337-b203-ceb1353db3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfc558c-4ab6-4d9e-b24c-49d82066ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:12 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Volume volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa (0acdc4a5-b01f-411a-bd9f-55211a6bb5fa): created successfully Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfc558c-4ab6-4d9e-b24c-49d82066ad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (5637ba53-0653-4773-a10e-82e172b46d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1b2eb2e9-0d48-4754-b81d-b98416abf505 tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-667cdf5c-bc39-47e4-b4e2-fd17e0cd38b3 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" by "attach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-667cdf5c-bc39-47e4-b4e2-fd17e0cd38b3 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" acquired by "attach_volume" :: waited 0.035s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-667cdf5c-bc39-47e4-b4e2-fd17e0cd38b3 tempest-VolumesActionsTest-1726427343 None] Attaching volume 0acdc4a5-b01f-411a-bd9f-55211a6bb5fa to instance 024fc49a-3063-4171-a50d-0997d50b0b34 at mountpoint /dev/vdb on host None. Apr 28 15:21:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-667cdf5c-bc39-47e4-b4e2-fd17e0cd38b3 tempest-VolumesActionsTest-1726427343 None] Attach volume completed successfully. Apr 28 15:21:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-667cdf5c-bc39-47e4-b4e2-fd17e0cd38b3 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" released by "attach_volume" :: held 0.115s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:13 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Terminate volume connection completed successfully. Apr 28 15:21:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" by "detach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Detaching volume 0acdc4a5-b01f-411a-bd9f-55211a6bb5fa from instance 024fc49a-3063-4171-a50d-0997d50b0b34. Apr 28 15:21:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Detach volume completed successfully. Apr 28 15:21:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6faf1b85-dc9e-4aed-bb71-6f8f8f0c1dfa tempest-VolumesActionsTest-440680465 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70d592a6-c6a1-49c4-9564-e5251c4987dd tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" by "detach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70d592a6-c6a1-49c4-9564-e5251c4987dd tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-70d592a6-c6a1-49c4-9564-e5251c4987dd tempest-VolumesActionsTest-1726427343 None] Volume detach called, but volume not attached. Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70d592a6-c6a1-49c4-9564-e5251c4987dd tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-quobyte-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-quobyte-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" acquired by "delete_volume" :: waited 0.037s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea128f-10ab-429d-a117-c8a760ce56e5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:15 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa Apr 28 15:21:15 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:16 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" returned: 0 in 0.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:16 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa Apr 28 15:21:16 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:17 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" returned: 0 in 0.617s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-quobyte-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa" released by "delete_volume" :: held 1.424s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Created reservations ['1048529c-386a-4aa8-94a8-fb3d1720f2e5', 'ec66d020-9046-4929-98c0-aa48f48ea56d', 'dbdfe99b-6926-482a-9e1d-3799ff72ef07', '14939dd3-5d43-49d6-bcf4-f77797eb5444'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:17 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:21:17 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:18 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:18 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Deleted volume successfully. Apr 28 15:21:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-519ac573-c4e5-486c-a7c4-593c735ffc47 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-0acdc4a5-b01f-411a-bd9f-55211a6bb5fa-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (aa2529b1-771f-43e9-8f1c-10bc3a478bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b792694f-832d-4f2c-b959-c0fd854c6e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b792694f-832d-4f2c-b959-c0fd854c6e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-659610019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49a7785-f74c-4937-b748-27e96d3e8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:25Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02a90ff-5c3c-4ec7-9a64-440ba5264061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02a90ff-5c3c-4ec7-9a64-440ba5264061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e728ac6-5cc8-4169-bb3e-fad161401f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e728ac6-5cc8-4169-bb3e-fad161401f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49a7785-f74c-4937-b748-27e96d3e8f7c', 'volume_name': 'volume-a49a7785-f74c-4937-b748-27e96d3e8f7c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d521e2-6b20-42cc-8ce6-aa20f36676a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d521e2-6b20-42cc-8ce6-aa20f36676a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7743fbf-db2a-4eee-9844-680b98158bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:25 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Volume a49a7785-f74c-4937-b748-27e96d3e8f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49a7785-f74c-4937-b748-27e96d3e8f7c', 'volume_size': 1} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-659610019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49a7785-f74c-4937-b748-27e96d3e8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:25Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Creating volume a49a7785-f74c-4937-b748-27e96d3e8f7c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:21:25 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:21:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:25 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c 1073741824 Apr 28 15:21:25 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:26 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c 1073741824" returned: 0 in 1.012s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:26 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c Apr 28 15:21:26 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:26 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c" returned: 0 in 0.647s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7743fbf-db2a-4eee-9844-680b98158bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49a7785-f74c-4937-b748-27e96d3e8f7c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8758921a-4185-4156-aaf5-158e80bb470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:26 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Volume volume-a49a7785-f74c-4937-b748-27e96d3e8f7c (a49a7785-f74c-4937-b748-27e96d3e8f7c): created successfully Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8758921a-4185-4156-aaf5-158e80bb470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (aa2529b1-771f-43e9-8f1c-10bc3a478bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b786acab-11b1-4e14-86e2-d0762c92555d tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-a49a7785-f74c-4937-b748-27e96d3e8f7c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "cinder-a49a7785-f74c-4937-b748-27e96d3e8f7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-quobyte-a49a7785-f74c-4937-b748-27e96d3e8f7c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-a49a7785-f74c-4937-b748-27e96d3e8f7c" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd34e3-d580-4405-a525-716a4dfe94ff]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:27 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c Apr 28 15:21:27 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-65b9cb31-1666-4a94-90a7-765b589c196a tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" by "attach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-65b9cb31-1666-4a94-90a7-765b589c196a tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" acquired by "attach_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:27 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-65b9cb31-1666-4a94-90a7-765b589c196a tempest-VolumesActionsTest-1377479458 None] Attaching volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c to instance 2dc2de7b-d3d2-4892-9b55-4a495f4d76af at mountpoint /dev/vdb on host None. Apr 28 15:21:27 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-65b9cb31-1666-4a94-90a7-765b589c196a tempest-VolumesActionsTest-1377479458 None] Attach volume completed successfully. Apr 28 15:21:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-65b9cb31-1666-4a94-90a7-765b589c196a tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c" released by "attach_volume" :: held 0.096s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:28 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c" returned: 0 in 0.862s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:28 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c Apr 28 15:21:28 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2849abb4-7f0f-42de-8008-288dd3da1d57 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" by "detach_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2849abb4-7f0f-42de-8008-288dd3da1d57 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2849abb4-7f0f-42de-8008-288dd3da1d57 tempest-VolumesActionsTest-1377479458 None] Detaching volume 14a9f854-cdfa-4133-b198-2c26ed4bb98c from instance 2dc2de7b-d3d2-4892-9b55-4a495f4d76af. Apr 28 15:21:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2849abb4-7f0f-42de-8008-288dd3da1d57 tempest-VolumesActionsTest-1377479458 None] Detach volume completed successfully. Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2849abb4-7f0f-42de-8008-288dd3da1d57 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:28 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a49a7785-f74c-4937-b748-27e96d3e8f7c" returned: 0 in 0.647s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-a49a7785-f74c-4937-b748-27e96d3e8f7c" released by "delete_volume" :: held 1.553s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:28 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Created reservations ['a229c73d-15f0-451c-a21c-baebca4338cd', '9b3ac271-6914-4e84-a7e3-00024b8b9047', '14229425-9644-42a7-ae7f-1e785bab930e', '0f79b2f6-b6ed-4e4c-99e2-d19750331d8c'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:29 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:21:29 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:29 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.638s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Deleted volume successfully. Apr 28 15:21:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-6bf3e0af-855d-4f18-b8d7-d44c7410bec6 tempest-VolumesActionsTest-440680465 None] Lock "cinder-a49a7785-f74c-4937-b748-27e96d3e8f7c-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (b21ab855-718d-444a-85dd-8f0076ca1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0a7c20-2926-4ebd-b8f5-2a1958528963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0a7c20-2926-4ebd-b8f5-2a1958528963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-97077362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c003ca17-de5c-456d-b6f8-61efa509a4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:30Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0747935d-88db-49d4-bd4d-40dee4d8c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0747935d-88db-49d4-bd4d-40dee4d8c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ecda63-cdbd-4a2e-90ec-69fbc90d1cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ecda63-cdbd-4a2e-90ec-69fbc90d1cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c003ca17-de5c-456d-b6f8-61efa509a4d4', 'volume_name': 'volume-c003ca17-de5c-456d-b6f8-61efa509a4d4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1406ea3b-bb04-44f0-9c08-621ef24950f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1406ea3b-bb04-44f0-9c08-621ef24950f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ed13d4-3615-4efd-ade1-888505d29978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Volume c003ca17-de5c-456d-b6f8-61efa509a4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c003ca17-de5c-456d-b6f8-61efa509a4d4', 'volume_size': 1} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-97077362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c003ca17-de5c-456d-b6f8-61efa509a4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:30Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Creating volume c003ca17-de5c-456d-b6f8-61efa509a4d4 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:21:30 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:21:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:30 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 1073741824 Apr 28 15:21:30 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:31 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 1073741824" returned: 0 in 1.042s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:31 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 Apr 28 15:21:31 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:31 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4" returned: 0 in 0.633s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ed13d4-3615-4efd-ade1-888505d29978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c003ca17-de5c-456d-b6f8-61efa509a4d4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c4a3e6-2199-4bb8-868b-718b48202621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:31 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Volume volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 (c003ca17-de5c-456d-b6f8-61efa509a4d4): created successfully Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c4a3e6-2199-4bb8-868b-718b48202621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:31 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (b21ab855-718d-444a-85dd-8f0076ca1150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:31 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-53b352a8-796a-4025-9629-875bea43f1ab tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-c003ca17-de5c-456d-b6f8-61efa509a4d4-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "cinder-c003ca17-de5c-456d-b6f8-61efa509a4d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-quobyte-c003ca17-de5c-456d-b6f8-61efa509a4d4" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-c003ca17-de5c-456d-b6f8-61efa509a4d4" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a780733-164d-4565-9870-a7164fc074bb]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:32 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 Apr 28 15:21:32 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:33 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4" returned: 0 in 0.709s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:33 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4 Apr 28 15:21:33 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:33 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c003ca17-de5c-456d-b6f8-61efa509a4d4" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-c003ca17-de5c-456d-b6f8-61efa509a4d4" released by "delete_volume" :: held 1.398s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Created reservations ['64ad7d72-de28-4e88-a407-b693ffb07c06', 'c1f3762a-d77d-4222-bb28-0c10e3f09ad0', 'b0d8f266-cebc-4714-855d-bb3f966a7355', '077d39a5-9a6f-4ee2-839a-486087d06f39'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:33 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:21:33 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:34 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.612s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:34 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:34 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Deleted volume successfully. Apr 28 15:21:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d8f4bdb-5c8d-4fd3-a4ee-110f3e0ac9fc tempest-VolumesActionsTest-440680465 None] Lock "cinder-c003ca17-de5c-456d-b6f8-61efa509a4d4-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (142be3b3-5639-4f87-b6b6-da28183e6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4d7414-06ab-40bc-8a49-703f93f7f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4d7414-06ab-40bc-8a49-703f93f7f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417389062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f20323-defd-4df6-80e3-ef89d5e4fe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:35Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273edbcb-4e4c-4ae3-9842-b561e79b2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273edbcb-4e4c-4ae3-9842-b561e79b2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d8c59-d28a-49aa-a82f-0f5713dbe1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d8c59-d28a-49aa-a82f-0f5713dbe1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f20323-defd-4df6-80e3-ef89d5e4fe2a', 'volume_name': 'volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc03596-0a13-4d05-9301-8817630b0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc03596-0a13-4d05-9301-8817630b0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bc685a-6f80-41c6-8ca0-73c013c927d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Volume 33f20323-defd-4df6-80e3-ef89d5e4fe2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a', 'volume_size': 1} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417389062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f20323-defd-4df6-80e3-ef89d5e4fe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:35Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Creating volume 33f20323-defd-4df6-80e3-ef89d5e4fe2a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:21:35 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:35 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a 1073741824 Apr 28 15:21:35 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:35 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a 1073741824" returned: 0 in 0.841s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:36 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a Apr 28 15:21:36 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:36 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a" returned: 0 in 0.617s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bc685a-6f80-41c6-8ca0-73c013c927d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0862c3-8a4d-4f58-accd-016e7cf254a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:36 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Volume volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a (33f20323-defd-4df6-80e3-ef89d5e4fe2a): created successfully Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0862c3-8a4d-4f58-accd-016e7cf254a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (142be3b3-5639-4f87-b6b6-da28183e6f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:36 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-99424524-6136-446f-aaec-49937077f0a9 tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19d589d-7a40-4763-9003-e3b95c1ade94]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:37 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:21:37 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-33f20323-defd-4df6-80e3-ef89d5e4fe2a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "cinder-33f20323-defd-4df6-80e3-ef89d5e4fe2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-quobyte-33f20323-defd-4df6-80e3-ef89d5e4fe2a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-33f20323-defd-4df6-80e3-ef89d5e4fe2a" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef524c-443b-4c83-88da-32da2401eee2]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:37 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a Apr 28 15:21:37 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:37 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.805s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555044c-9e79-4242-b518-751e499f23c2]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:38 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:21:38 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:38 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a" returned: 0 in 0.776s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:38 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a Apr 28 15:21:38 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:38 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.774s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8dr1mcz6xv.img {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:38 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8dr1mcz6xv.img Apr 28 15:21:38 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:38 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-33f20323-defd-4df6-80e3-ef89d5e4fe2a" returned: 0 in 0.663s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-33f20323-defd-4df6-80e3-ef89d5e4fe2a" released by "delete_volume" :: held 1.485s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:38 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Created reservations ['123b0e43-7707-4b64-a1cb-bbbc55d9e485', '094f8932-f636-4a77-947d-f1772b16fd35', '1ff625be-87c4-4b0f-97da-5d2e5f60b562', 'cf88d50e-4f77-4496-87bb-f0a88487b773'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:39 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:21:39 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:40 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.256s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Deleted volume successfully. Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-36bd517a-7a68-4d4f-9ac4-6106b0d015d9 tempest-VolumesActionsTest-440680465 None] Lock "cinder-33f20323-defd-4df6-80e3-ef89d5e4fe2a-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (018ed359-b866-470a-bb64-44e2e868cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff74a6a-fe80-47bd-bf70-64ec26d1bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff74a6a-fe80-47bd-bf70-64ec26d1bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921852718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f627b3d-f664-48ec-b687-3c4711a9f63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:41Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19097dc1-d490-48ed-8228-df2b705174cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19097dc1-d490-48ed-8228-df2b705174cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eedc4c-1a86-4fae-9257-e938a689c104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eedc4c-1a86-4fae-9257-e938a689c104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f627b3d-f664-48ec-b687-3c4711a9f63a', 'volume_name': 'volume-1f627b3d-f664-48ec-b687-3c4711a9f63a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e22266-ac97-45ce-8890-51b4d5d19e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e22266-ac97-45ce-8890-51b4d5d19e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf752cb6-18fb-478b-884d-98ae78033f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:21:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Volume 1f627b3d-f664-48ec-b687-3c4711a9f63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f627b3d-f664-48ec-b687-3c4711a9f63a', 'volume_size': 1} Apr 28 15:21:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:43 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8dr1mcz6xv.img" returned: 0 in 4.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:43 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efecec5-bea5-4ff9-b8e7-a18591fc1cdd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:21:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:43 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:21:43 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:44 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.869s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:44 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8dr1mcz6xv.img {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:21:44 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Converted 1024.00 MB image at 215.36 MB/s Apr 28 15:21:44 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] 436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8d was raw, no need to convert to raw {{(pid=84270) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:21:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:21:50 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:21:50 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:21:51 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 28 15:21:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:21:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:21:54 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:21:54 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:INSERT=12,cinder:SELECT=45,cinder:UPDATE=53,cinder:DELETE=5 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.875s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Uploaded volume to glance image-id: 436585d2-3f1b-4ae3-8ac9-f82e7b5d5c8d. {{(pid=84270) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.019s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921852718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f627b3d-f664-48ec-b687-3c4711a9f63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:21:41Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Creating volume 1f627b3d-f664-48ec-b687-3c4711a9f63a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:02 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:02 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a 1073741824 Apr 28 15:22:02 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:02 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b9ff5475-8ddc-4163-a948-55c6a5b69cec tempest-VolumesActionsTest-1377479458 None] Copy volume to image completed successfully. Apr 28 15:22:03 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a 1073741824" returned: 0 in 0.826s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:03 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a Apr 28 15:22:03 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:04 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a" returned: 0 in 0.595s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.613s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf752cb6-18fb-478b-884d-98ae78033f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f627b3d-f664-48ec-b687-3c4711a9f63a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff944a4d-81a8-4607-a9cc-fc8e40cf916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52be9c-d22a-47cd-b117-35db80ad9ffc]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:04 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Volume volume-1f627b3d-f664-48ec-b687-3c4711a9f63a (1f627b3d-f664-48ec-b687-3c4711a9f63a): created successfully Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff944a4d-81a8-4607-a9cc-fc8e40cf916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (018ed359-b866-470a-bb64-44e2e868cd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7eda76a9-3512-44d8-992b-baf7bd061d93 tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:22:04 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:22:04 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:05 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.706s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d60801-7d2f-47d7-b407-10681a68f962]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:05 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:22:05 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-1f627b3d-f664-48ec-b687-3c4711a9f63a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "cinder-1f627b3d-f664-48ec-b687-3c4711a9f63a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Acquiring lock "cinder-quobyte-1f627b3d-f664-48ec-b687-3c4711a9f63a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-1f627b3d-f664-48ec-b687-3c4711a9f63a" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf4895-9076-413c-b2b6-ac7a1a7ab408]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:05 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a Apr 28 15:22:05 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:05 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:05 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img Apr 28 15:22:05 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:06 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a" returned: 0 in 0.724s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:06 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a Apr 28 15:22:06 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:07 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1f627b3d-f664-48ec-b687-3c4711a9f63a" returned: 0 in 1.053s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "cinder-quobyte-1f627b3d-f664-48ec-b687-3c4711a9f63a" released by "delete_volume" :: held 1.844s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Created reservations ['b566f091-06fd-42f7-8a61-38669bade9df', '65b184f7-d25b-4dbd-a694-498f50ed732e', '62b12c5e-803c-450f-bc6c-c643b3ae8b76', 'f64c0a21-589f-454e-b8ae-92415793566d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:07 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:07 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:08 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.014s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Deleted volume successfully. Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ce17c7c8-e667-4963-bef3-6e31eecc4788 tempest-VolumesActionsTest-440680465 None] Lock "cinder-1f627b3d-f664-48ec-b687-3c4711a9f63a-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (a77fc5b8-db6f-4663-bcf4-b852326daf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2982f8-c3e1-43b9-b15a-81de44624d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2982f8-c3e1-43b9-b15a-81de44624d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-586207681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a60841f-355c-4d85-8a68-c4e8b76c593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:09Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f271327-0db6-4117-8e5f-185b62e769ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f271327-0db6-4117-8e5f-185b62e769ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d73dd-fce6-4267-a74a-ab6c6f27ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d73dd-fce6-4267-a74a-ab6c6f27ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a60841f-355c-4d85-8a68-c4e8b76c593a', 'volume_name': 'volume-6a60841f-355c-4d85-8a68-c4e8b76c593a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d6a889-21f0-41bf-9668-a2f91237b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d6a889-21f0-41bf-9668-a2f91237b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f8c964-2d04-4984-be66-af773e7539cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:08 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Volume 6a60841f-355c-4d85-8a68-c4e8b76c593a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a60841f-355c-4d85-8a68-c4e8b76c593a', 'volume_size': 1} Apr 28 15:22:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:10 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img" returned: 0 in 4.897s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:10 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567333c-69ec-4c60-9a19-af085fb54fe9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:10 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:22:10 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:11 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.858s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:11 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:22:11 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Converted 1024.00 MB image at 209.06 MB/s Apr 28 15:22:11 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] 68d562cf-f090-4eed-8e7c-cb0e575e0d73 was raw, converting to qcow2 {{(pid=84270) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 28 15:22:11 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e94f5-7ead-4861-bb3d-5e76948c3579]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:11 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img Apr 28 15:22:11 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:12 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img" returned: 0 in 0.678s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:12 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img Apr 28 15:22:12 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:13 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img" returned: 1 in 0.677s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img /opt/stack/data/cinder/conversion/vol_upload_4qone_um {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:13 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img /opt/stack/data/cinder/conversion/vol_upload_4qone_um Apr 28 15:22:13 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:13 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img /opt/stack/data/cinder/conversion/vol_upload_4qone_um" returned: 0 in 0.622s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Image conversion details: src /opt/stack/data/cinder/conversion/14a9f854-cdfa-4133-b198-2c26ed4bb98c.temp_image.68d562cf-f090-4eed-8e7c-cb0e575e0d73p6gq7cl5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4qone_um {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:22:13 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ccb0a-2236-4298-a95c-b215f9045833]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4qone_um {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:13 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4qone_um Apr 28 15:22:13 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:14 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4qone_um" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.206s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Uploaded volume to glance image-id: 68d562cf-f090-4eed-8e7c-cb0e575e0d73. {{(pid=84270) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.703s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-586207681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a60841f-355c-4d85-8a68-c4e8b76c593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0d613209241f4b28228d9327a04d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:09Z,use_quota=True,user_id='b5a706b641ca4973be9ea1118226d657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Creating volume 6a60841f-355c-4d85-8a68-c4e8b76c593a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:15 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:15 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a 1073741824 Apr 28 15:22:15 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:15 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-449b1b79-6963-4483-a6ae-29259c7c84a0 tempest-VolumesActionsTest-1377479458 None] Copy volume to image completed successfully. Apr 28 15:22:16 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a 1073741824" returned: 0 in 0.800s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:16 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a Apr 28 15:22:16 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "cinder-quobyte-14a9f854-cdfa-4133-b198-2c26ed4bb98c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-quobyte-14a9f854-cdfa-4133-b198-2c26ed4bb98c" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545d0c3-3753-4ec5-b52c-7e479271ba5e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:17 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a" returned: 0 in 0.634s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f8c964-2d04-4984-be66-af773e7539cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a60841f-355c-4d85-8a68-c4e8b76c593a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8696cdcc-f83a-48c0-acd0-6b9d4b953fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Volume volume-6a60841f-355c-4d85-8a68-c4e8b76c593a (6a60841f-355c-4d85-8a68-c4e8b76c593a): created successfully Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8696cdcc-f83a-48c0-acd0-6b9d4b953fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Flow 'volume_create_manager' (a77fc5b8-db6f-4663-bcf4-b852326daf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c3e0a844-45e0-476e-a15e-ed8fcafcde3c tempest-VolumesActionsTest-1726427343 None] Created volume successfully. Apr 28 15:22:17 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:22:17 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:17 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.751s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:17 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c Apr 28 15:22:17 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-6a60841f-355c-4d85-8a68-c4e8b76c593a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-6a60841f-355c-4d85-8a68-c4e8b76c593a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "cinder-quobyte-6a60841f-355c-4d85-8a68-c4e8b76c593a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-quobyte-6a60841f-355c-4d85-8a68-c4e8b76c593a" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f9d8a8-2f4b-451b-8157-addcc46bffad]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:18 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a Apr 28 15:22:18 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:18 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-14a9f854-cdfa-4133-b198-2c26ed4bb98c" returned: 0 in 0.658s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-quobyte-14a9f854-cdfa-4133-b198-2c26ed4bb98c" released by "delete_volume" :: held 1.450s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Created reservations ['7565e52b-777d-4747-b50f-8e5a785fc0e8', 'a4b30d30-0a36-4330-87d7-aa0fedbfccb4', '58f56442-f8d7-484b-9bc0-3e91fe329374', '00ff5262-0d22-483a-a77e-bfedeecb1975'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:18 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:18 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:18 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:18 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a Apr 28 15:22:18 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:19 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.625s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Deleted volume successfully. Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7d9d5c39-842a-4572-9589-d8703f82f873 tempest-VolumesActionsTest-1377479458 None] Lock "cinder-14a9f854-cdfa-4133-b198-2c26ed4bb98c-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:19 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6a60841f-355c-4d85-8a68-c4e8b76c593a" returned: 0 in 0.644s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-quobyte-6a60841f-355c-4d85-8a68-c4e8b76c593a" released by "delete_volume" :: held 1.391s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Created reservations ['8339bd84-77ee-4c73-bab9-3aa49ddf8f0a', '28434a42-d118-462f-86b4-39c142793095', '99c67751-d1ff-4a23-a422-a7e31d2ed790', '812a0e03-851c-4eb1-b0ee-f00e7a541f80'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:19 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:19 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:20 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.643s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:20 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Deleted volume successfully. Apr 28 15:22:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e9e31d1c-4f99-4c6f-bb8e-b7ba1e9e5734 tempest-VolumesActionsTest-1726427343 None] Lock "cinder-6a60841f-355c-4d85-8a68-c4e8b76c593a-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Flow 'volume_create_manager' (8b61c4e0-7bd5-4e5c-9f02-615570b834a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f7127-29f5-4f1c-9810-23104a4d364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f7127-29f5-4f1c-9810-23104a4d364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1952386674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a5cec-7997-44dc-8482-b550bb76256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668d892460e4993a6a1b10b0d2dfdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:25Z,use_quota=True,user_id='22b5269197ea443a981c34bd861b66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dac753-79c3-4486-b906-c1d8d460bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dac753-79c3-4486-b906-c1d8d460bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec26650-1b85-4eea-a27b-896bf45e723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec26650-1b85-4eea-a27b-896bf45e723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8a5cec-7997-44dc-8482-b550bb76256e', 'volume_name': 'volume-ad8a5cec-7997-44dc-8482-b550bb76256e', 'volume_size': 2}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069ed37-cf79-4189-bea8-c893aaa15a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069ed37-cf79-4189-bea8-c893aaa15a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dce83c-be4b-41fd-8f28-7c7c2ef4fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:25 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Volume ad8a5cec-7997-44dc-8482-b550bb76256e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8a5cec-7997-44dc-8482-b550bb76256e', 'volume_size': 2} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1952386674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a5cec-7997-44dc-8482-b550bb76256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668d892460e4993a6a1b10b0d2dfdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:25Z,use_quota=True,user_id='22b5269197ea443a981c34bd861b66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Creating volume ad8a5cec-7997-44dc-8482-b550bb76256e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:25 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e 2147483648 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:25 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e 2147483648 Apr 28 15:22:25 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:26 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e 2147483648" returned: 0 in 0.873s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:26 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e Apr 28 15:22:26 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:27 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e" returned: 0 in 0.724s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dce83c-be4b-41fd-8f28-7c7c2ef4fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8a5cec-7997-44dc-8482-b550bb76256e', 'volume_size': 2}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0994c422-c32c-4d40-a6c6-8c99b3b4295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Volume volume-ad8a5cec-7997-44dc-8482-b550bb76256e (ad8a5cec-7997-44dc-8482-b550bb76256e): created successfully Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0994c422-c32c-4d40-a6c6-8c99b3b4295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Flow 'volume_create_manager' (8b61c4e0-7bd5-4e5c-9f02-615570b834a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:27 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-39ec9f82-5d48-4eff-9526-15697d2f7705 tempest-VolumesCloneNegativeTest-714058529 None] Created volume successfully. Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Acquiring lock "cinder-ad8a5cec-7997-44dc-8482-b550bb76256e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "cinder-ad8a5cec-7997-44dc-8482-b550bb76256e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Acquiring lock "cinder-quobyte-ad8a5cec-7997-44dc-8482-b550bb76256e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "cinder-quobyte-ad8a5cec-7997-44dc-8482-b550bb76256e" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a8d38-caf3-4045-818d-d97245ee7872]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:28 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e Apr 28 15:22:28 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:28 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e" returned: 0 in 0.732s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:28 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e Apr 28 15:22:28 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:29 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ad8a5cec-7997-44dc-8482-b550bb76256e" returned: 0 in 0.591s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "cinder-quobyte-ad8a5cec-7997-44dc-8482-b550bb76256e" released by "delete_volume" :: held 1.372s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Created reservations ['a0ca8703-09bd-4bf5-bb66-618463bf458c', 'cadaf081-0d4e-408e-b2cd-d496cffcfaee', 'aace4794-a140-4adc-be93-2f306faa62c1', 'dd6dd53b-5247-49fc-8dd8-9940826f443c'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:29 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:29 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:30 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.636s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:30 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Deleted volume successfully. Apr 28 15:22:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2d3298ff-e895-452a-9e5f-fcb24c98e904 tempest-VolumesCloneNegativeTest-714058529 None] Lock "cinder-ad8a5cec-7997-44dc-8482-b550bb76256e-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (7bced5f6-eba2-4391-9a1a-9b17746e2ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077a559-666a-462a-8af9-538ee95d2e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077a559-666a-462a-8af9-538ee95d2e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-97670220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d647adb-a7d8-4cab-94b0-08e76267951c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:33Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a84b98-1bf8-4ba2-8dfe-d7ab350fded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a84b98-1bf8-4ba2-8dfe-d7ab350fded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d249099f-54e6-4c20-9dcf-fd25e2f1edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d249099f-54e6-4c20-9dcf-fd25e2f1edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d647adb-a7d8-4cab-94b0-08e76267951c', 'volume_name': 'volume-2d647adb-a7d8-4cab-94b0-08e76267951c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ae9e4b-4d77-4af0-87ad-01be2633937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ae9e4b-4d77-4af0-87ad-01be2633937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0426fb5-cc16-4b24-91f0-e7b6ac86ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:33 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Volume 2d647adb-a7d8-4cab-94b0-08e76267951c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d647adb-a7d8-4cab-94b0-08e76267951c', 'volume_size': 1} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-97670220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d647adb-a7d8-4cab-94b0-08e76267951c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:33Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Creating volume 2d647adb-a7d8-4cab-94b0-08e76267951c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:33 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:33 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c 1073741824 Apr 28 15:22:33 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:34 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c 1073741824" returned: 0 in 0.846s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:34 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c Apr 28 15:22:34 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:34 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c" returned: 0 in 0.657s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0426fb5-cc16-4b24-91f0-e7b6ac86ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d647adb-a7d8-4cab-94b0-08e76267951c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8028ed8-d6bb-4a8b-923b-b4e6201d2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:34 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Volume volume-2d647adb-a7d8-4cab-94b0-08e76267951c (2d647adb-a7d8-4cab-94b0-08e76267951c): created successfully Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8028ed8-d6bb-4a8b-923b-b4e6201d2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (7bced5f6-eba2-4391-9a1a-9b17746e2ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:34 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e3129581-93ca-4306-b61c-d27d6b8233ec tempest-VolumesListTestJSON-1144949227 None] Created volume successfully. Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Flow 'volume_create_manager' (e5cc4b24-82a5-4b69-9982-382849984790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0adcf-3311-4ac4-b0f7-7c910d2f8c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0adcf-3311-4ac4-b0f7-7c910d2f8c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-694295604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db024935-72c3-4f5c-97ca-d8d4a958be9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad157c9bb8a74f048666230972e1edcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:35Z,use_quota=True,user_id='68f06d819178443ebff40d81b6276fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981c2c4c-600d-451c-8867-7ea28ef4b6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981c2c4c-600d-451c-8867-7ea28ef4b6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd84fd-4f7f-4802-bd7c-dfcfc34fdb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd84fd-4f7f-4802-bd7c-dfcfc34fdb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db024935-72c3-4f5c-97ca-d8d4a958be9a', 'volume_name': 'volume-db024935-72c3-4f5c-97ca-d8d4a958be9a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e156acce-f29b-4b73-9fea-a67a56229418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e156acce-f29b-4b73-9fea-a67a56229418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d26a28c-3313-4463-8b87-7d5492b4809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Volume db024935-72c3-4f5c-97ca-d8d4a958be9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db024935-72c3-4f5c-97ca-d8d4a958be9a', 'volume_size': 1} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-694295604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db024935-72c3-4f5c-97ca-d8d4a958be9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad157c9bb8a74f048666230972e1edcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:35Z,use_quota=True,user_id='68f06d819178443ebff40d81b6276fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Creating volume db024935-72c3-4f5c-97ca-d8d4a958be9a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:35 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:35 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a 1073741824 Apr 28 15:22:35 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (29e4c9ba-0ab7-4de0-a0c1-90a277fd5331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6573d8-67fb-48f6-a154-a66cdc31a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6573d8-67fb-48f6-a154-a66cdc31a87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-32747945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baf511c-f15b-4c04-ac81-cf3b4a3cec3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:36Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b022515f-1f15-4cb6-bb35-42a9fdc55000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b022515f-1f15-4cb6-bb35-42a9fdc55000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1545396a-aa9f-4a9a-a83c-209207643816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1545396a-aa9f-4a9a-a83c-209207643816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4baf511c-f15b-4c04-ac81-cf3b4a3cec3e', 'volume_name': 'volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5d5e80-1442-4695-aa18-ac903f32bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5d5e80-1442-4695-aa18-ac903f32bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb06630-18a2-4352-9983-a2c881f8494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Volume 4baf511c-f15b-4c04-ac81-cf3b4a3cec3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e', 'volume_size': 1} Apr 28 15:22:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:36 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a 1073741824" returned: 0 in 0.828s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:36 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a Apr 28 15:22:36 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:36 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a" returned: 0 in 0.591s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-32747945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baf511c-f15b-4c04-ac81-cf3b4a3cec3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:36Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Creating volume 4baf511c-f15b-4c04-ac81-cf3b4a3cec3e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:36 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d26a28c-3313-4463-8b87-7d5492b4809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db024935-72c3-4f5c-97ca-d8d4a958be9a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:36 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e 1073741824 Apr 28 15:22:36 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c316c-a02b-43be-8b52-1af09e47c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:36 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Volume volume-db024935-72c3-4f5c-97ca-d8d4a958be9a (db024935-72c3-4f5c-97ca-d8d4a958be9a): created successfully Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c316c-a02b-43be-8b52-1af09e47c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:36 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Flow 'volume_create_manager' (e5cc4b24-82a5-4b69-9982-382849984790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:36 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4fa7aac8-316e-42b8-b7a6-72dfbe64ff38 tempest-VolumesTransfersV355Test-1825533454 None] Created volume successfully. Apr 28 15:22:37 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e 1073741824" returned: 0 in 0.839s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:37 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e Apr 28 15:22:37 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:37 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6a241c53-245e-4672-bbd7-d36dac0a6dc2 tempest-VolumesTransfersV355Test-855284910 None] Transfer volume completed successfully. Apr 28 15:22:38 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" returned: 0 in 0.594s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb06630-18a2-4352-9983-a2c881f8494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c02c71-03ff-441a-b108-2d331f375add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Volume volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e (4baf511c-f15b-4c04-ac81-cf3b4a3cec3e): created successfully Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c02c71-03ff-441a-b108-2d331f375add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (29e4c9ba-0ab7-4de0-a0c1-90a277fd5331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-bcc2b9a5-f863-43fb-9ef9-2419a23107d9 tempest-VolumesListTestJSON-1144949227 None] Created volume successfully. Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "cinder-db024935-72c3-4f5c-97ca-d8d4a958be9a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-db024935-72c3-4f5c-97ca-d8d4a958be9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "cinder-quobyte-db024935-72c3-4f5c-97ca-d8d4a958be9a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-quobyte-db024935-72c3-4f5c-97ca-d8d4a958be9a" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d46c76-67cf-4dbd-8aff-01816d791f74]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:38 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a Apr 28 15:22:38 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (ca2bd000-f6ad-4b66-bf8f-a9953815d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1f69f8-94e2-4482-827b-993752a567da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1f69f8-94e2-4482-827b-993752a567da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628334314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3f970b-48b2-48e8-ab92-b30207e3552b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:39Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cd368b-ad8c-4b99-b976-16450bb276f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cd368b-ad8c-4b99-b976-16450bb276f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac279fd5-6f63-44ba-b7d8-f039db11dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac279fd5-6f63-44ba-b7d8-f039db11dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3f970b-48b2-48e8-ab92-b30207e3552b', 'volume_name': 'volume-4e3f970b-48b2-48e8-ab92-b30207e3552b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0c5d1-74af-4216-8c32-91f033d9daa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0c5d1-74af-4216-8c32-91f033d9daa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4ff723-7b02-43bc-86f8-5dbe8fe65122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:39 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Volume 4e3f970b-48b2-48e8-ab92-b30207e3552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3f970b-48b2-48e8-ab92-b30207e3552b', 'volume_size': 1} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628334314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3f970b-48b2-48e8-ab92-b30207e3552b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a90ff1ab287414c890fe3abec05632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:39Z,use_quota=True,user_id='a66673d242bf4d8bb64c7bb936b85f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Creating volume 4e3f970b-48b2-48e8-ab92-b30207e3552b {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:39 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:39 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b 1073741824 Apr 28 15:22:39 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:39 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a" returned: 0 in 0.760s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:39 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a Apr 28 15:22:39 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:40 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-db024935-72c3-4f5c-97ca-d8d4a958be9a" returned: 0 in 0.595s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-quobyte-db024935-72c3-4f5c-97ca-d8d4a958be9a" released by "delete_volume" :: held 1.399s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:40 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b 1073741824" returned: 0 in 0.767s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Created reservations ['d2d4fbec-c56c-4a63-8df5-2e5ec562032d', '1c524c65-c22b-479d-b1f6-4eec86b191f4', 'bcf084a3-65e5-4358-8b84-81cdfd7af98d', 'e3c7ec96-d036-4859-8536-5ea8144784a0'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:40 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b Apr 28 15:22:40 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:40 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:40 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:40 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b" returned: 0 in 0.614s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4ff723-7b02-43bc-86f8-5dbe8fe65122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3f970b-48b2-48e8-ab92-b30207e3552b', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddef7453-2fec-4a65-8504-45ac0ed21ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Volume volume-4e3f970b-48b2-48e8-ab92-b30207e3552b (4e3f970b-48b2-48e8-ab92-b30207e3552b): created successfully Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddef7453-2fec-4a65-8504-45ac0ed21ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:40 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Flow 'volume_create_manager' (ca2bd000-f6ad-4b66-bf8f-a9953815d307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.611s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:40 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Deleted volume successfully. Apr 28 15:22:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-acb3a7b8-1cfb-4644-a468-9c7ecd7003d3 tempest-VolumesListTestJSON-1144949227 None] Created volume successfully. Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5b97a5be-10e6-4a56-84a6-58fc29b8b995 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-db024935-72c3-4f5c-97ca-d8d4a958be9a-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Flow 'volume_create_manager' (1a387447-1628-4dac-855b-5f56d8feab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7c005b-73e2-4b39-b348-d7a92461c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7c005b-73e2-4b39-b348-d7a92461c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-683323215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a6cfb4-cccc-4687-8953-f111049dded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad157c9bb8a74f048666230972e1edcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:41Z,use_quota=True,user_id='68f06d819178443ebff40d81b6276fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa476590-1f1f-4a44-bc76-92dba1d7e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa476590-1f1f-4a44-bc76-92dba1d7e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24cb4e8-eda8-4338-bf2f-6c45ce60a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24cb4e8-eda8-4338-bf2f-6c45ce60a370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a6cfb4-cccc-4687-8953-f111049dded7', 'volume_name': 'volume-f3a6cfb4-cccc-4687-8953-f111049dded7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f2e8b0-3a9f-4578-be15-f95d59a9bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f2e8b0-3a9f-4578-be15-f95d59a9bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48742fec-de5a-401f-a4bb-2d710ffd6fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:41 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Volume f3a6cfb4-cccc-4687-8953-f111049dded7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a6cfb4-cccc-4687-8953-f111049dded7', 'volume_size': 1} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-683323215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a6cfb4-cccc-4687-8953-f111049dded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad157c9bb8a74f048666230972e1edcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:41Z,use_quota=True,user_id='68f06d819178443ebff40d81b6276fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Creating volume f3a6cfb4-cccc-4687-8953-f111049dded7 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:41 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:41 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 1073741824 Apr 28 15:22:41 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:42 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 1073741824" returned: 0 in 0.818s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:42 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 Apr 28 15:22:42 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:42 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7" returned: 0 in 0.615s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48742fec-de5a-401f-a4bb-2d710ffd6fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a6cfb4-cccc-4687-8953-f111049dded7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:42 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99ee8d-5f4e-4591-aff0-576671914cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:43 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Volume volume-f3a6cfb4-cccc-4687-8953-f111049dded7 (f3a6cfb4-cccc-4687-8953-f111049dded7): created successfully Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99ee8d-5f4e-4591-aff0-576671914cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Flow 'volume_create_manager' (1a387447-1628-4dac-855b-5f56d8feab13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8775515b-6f72-44fb-9651-d34216d4cc0e tempest-VolumesTransfersV355Test-1825533454 None] Created volume successfully. Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "cinder-f3a6cfb4-cccc-4687-8953-f111049dded7-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-4e3f970b-48b2-48e8-ab92-b30207e3552b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-4e3f970b-48b2-48e8-ab92-b30207e3552b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-f3a6cfb4-cccc-4687-8953-f111049dded7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-quobyte-4e3f970b-48b2-48e8-ab92-b30207e3552b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "cinder-quobyte-f3a6cfb4-cccc-4687-8953-f111049dded7" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-4e3f970b-48b2-48e8-ab92-b30207e3552b" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-quobyte-f3a6cfb4-cccc-4687-8953-f111049dded7" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe3a1a8-9739-4b5b-84e1-4dc41fff6c59]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5064b6f-f608-4b69-96d5-e021e7839422]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:44 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b Apr 28 15:22:44 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:44 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 Apr 28 15:22:44 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:44 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7" returned: 0 in 0.697s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:44 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b" returned: 0 in 0.721s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:44 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7 Apr 28 15:22:44 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:44 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b Apr 28 15:22:44 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:45 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e3f970b-48b2-48e8-ab92-b30207e3552b" returned: 0 in 0.636s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:45 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f3a6cfb4-cccc-4687-8953-f111049dded7" returned: 0 in 0.664s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-4e3f970b-48b2-48e8-ab92-b30207e3552b" released by "delete_volume" :: held 1.413s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-quobyte-f3a6cfb4-cccc-4687-8953-f111049dded7" released by "delete_volume" :: held 1.409s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Created reservations ['1ea1e4ab-b1a9-4b8f-acae-350ebf3c5f43', 'e65cf5fa-8d82-451d-83d8-d793d271f0a8', 'f391317e-24cc-432c-b812-5a54a1290571', '6c01c80e-9142-4539-b639-9b8923e67129'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Created reservations ['955511ad-1718-4483-bdc1-70080bd52df1', '7c0cf228-952f-49b3-ae8d-59350a01118e', '4dcbecd5-091b-4d4a-8b93-c74d5aa0c7c3', '9be5316f-0534-49c0-bed3-5e2fb578d273'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:45 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:45 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:45 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:45 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:46 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.688s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Deleted volume successfully. Apr 28 15:22:46 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.673s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Deleted volume successfully. Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-quobyte-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-daf7c216-123b-447e-8ec3-95e2aa1c8196 tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-4e3f970b-48b2-48e8-ab92-b30207e3552b-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-aeaa5673-ff01-46bf-a629-e6dbd8582ec6 tempest-VolumesTransfersV355Test-621997685 None] Lock "cinder-f3a6cfb4-cccc-4687-8953-f111049dded7-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b9262-49fb-4124-b872-b4fe3edb3ae9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:46 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e Apr 28 15:22:46 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:47 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:47 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e Apr 28 15:22:47 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:47 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" returned: 0 in 0.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e" released by "delete_volume" :: held 1.434s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Created reservations ['db52094d-3929-481f-8397-d3c43d449de0', '56e48815-eefc-4bfc-b324-9b75375a31e5', 'c20d687a-8e7e-4f34-977b-395c2f0abbd6', '8caecfab-717d-4768-969e-e5dc87f90694'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:47 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:47 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:48 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.696s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-2d647adb-a7d8-4cab-94b0-08e76267951c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Deleted volume successfully. Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-2d647adb-a7d8-4cab-94b0-08e76267951c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-2da7e54e-7e27-4e51-bf70-4eb907d0fefe tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-4baf511c-f15b-4c04-ac81-cf3b4a3cec3e-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "cinder-quobyte-2d647adb-a7d8-4cab-94b0-08e76267951c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-2d647adb-a7d8-4cab-94b0-08e76267951c" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef5aac8-1950-49cf-928f-f111a2b6d893]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:48 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c Apr 28 15:22:48 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:49 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c" returned: 0 in 0.788s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:49 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c Apr 28 15:22:49 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:50 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-2d647adb-a7d8-4cab-94b0-08e76267951c" returned: 0 in 0.642s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-quobyte-2d647adb-a7d8-4cab-94b0-08e76267951c" released by "delete_volume" :: held 1.478s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Created reservations ['02608a2d-6d6a-48d8-b578-1ebf2bfa5b76', 'fbde421a-f7de-4f92-b182-69fdbf3bbfcb', 'a8cfc4df-9472-474a-8c4b-b080c6b433d6', '6df8ae45-0b31-4bca-b850-b30fd3c64f4c'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:50 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:50 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:50 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:22:50 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:50 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.612s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:50 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Deleted volume successfully. Apr 28 15:22:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7956e347-7ac2-45fd-901d-52a012eb895b tempest-VolumesListTestJSON-1144949227 None] Lock "cinder-2d647adb-a7d8-4cab-94b0-08e76267951c-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:22:51 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.673s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Flow 'volume_create_manager' (f5774749-0b78-4b8d-b361-db3b8498c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b825d1b-b6dd-405a-beb4-11e50d156ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b825d1b-b6dd-405a-beb4-11e50d156ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793466201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c98b9f4-fd8c-4442-bf35-f4e37bae27a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2dd1e0829e43bdbc898c386546a5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:52Z,use_quota=True,user_id='b253e68ff5454e5bacf5d8a1abd930e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1291bf0f-206d-4cc1-826e-d4f65d52ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1291bf0f-206d-4cc1-826e-d4f65d52ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b689716-2690-4339-b947-f2c052e1469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.image.glance [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Creating Keystone auth plugin from conf {{(pid=84270) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b689716-2690-4339-b947-f2c052e1469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c98b9f4-fd8c-4442-bf35-f4e37bae27a8', 'volume_name': 'volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a20222-15bc-4d7e-a09a-37bf75a7d0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a20222-15bc-4d7e-a09a-37bf75a7d0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f0478a-cd63-42d5-9c56-69d2985ad4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:52 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Trying to clone 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]). {{(pid=84270) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 15:22:52 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Image download 20.69 MB at 20.69 MB/s Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c0582-2241-4f0d-8614-e6dbd9ac13c5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:53 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD Apr 28 15:22:53 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:53 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e is fetched for user b253e68ff5454e5bacf5d8a1abd930e3. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d189745-26df-4e03-8451-50749f2da53e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:53 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD Apr 28 15:22:53 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Flow 'volume_create_manager' (5aecc69d-b341-45cb-b0d1-362e1ad3f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e13e77-965b-454a-9c71-6b14777e83ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e13e77-965b-454a-9c71-6b14777e83ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1882551174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998760c1-cc77-4b2c-957e-55714a827846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa395efa8c5b480c8e51d8a566676eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:54Z,use_quota=True,user_id='b2d9927365194cc2a7d4b22f27bae0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e410c48-99c9-453b-a6a7-0a8dced5f5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e410c48-99c9-453b-a6a7-0a8dced5f5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bce5009-b1d4-4f6a-ab8a-70bde6eb51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bce5009-b1d4-4f6a-ab8a-70bde6eb51f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998760c1-cc77-4b2c-957e-55714a827846', 'volume_name': 'volume-998760c1-cc77-4b2c-957e-55714a827846', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61109962-2019-4906-8eca-df61762dee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61109962-2019-4906-8eca-df61762dee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c6187-feb8-4537-ad1c-401888719d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:53 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Volume 998760c1-cc77-4b2c-957e-55714a827846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998760c1-cc77-4b2c-957e-55714a827846', 'volume_size': 1} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1882551174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998760c1-cc77-4b2c-957e-55714a827846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa395efa8c5b480c8e51d8a566676eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:54Z,use_quota=True,user_id='b2d9927365194cc2a7d4b22f27bae0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Creating volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:53 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:53 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 1073741824 Apr 28 15:22:53 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:54 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:54 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 1073741824" returned: 0 in 0.756s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=66,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=9 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=67,cinder:INSERT=19,cinder:UPDATE=94,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:22:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:54 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 Apr 28 15:22:54 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:55 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846" returned: 0 in 0.582s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793466201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c98b9f4-fd8c-4442-bf35-f4e37bae27a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2dd1e0829e43bdbc898c386546a5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:22:52Z,use_quota=True,user_id='b253e68ff5454e5bacf5d8a1abd930e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Creating volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:22:55 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c6187-feb8-4537-ad1c-401888719d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998760c1-cc77-4b2c-957e-55714a827846', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869592d3-344d-4d0f-84d8-a1d48593bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:22:55 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1073741824 Apr 28 15:22:55 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:55 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Volume volume-998760c1-cc77-4b2c-957e-55714a827846 (998760c1-cc77-4b2c-957e-55714a827846): created successfully Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869592d3-344d-4d0f-84d8-a1d48593bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:22:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Flow 'volume_create_manager' (5aecc69d-b341-45cb-b0d1-362e1ad3f62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:22:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-bc9c81c4-8daf-4a81-9c64-cf2f076a131c tempest-VolumesSnapshotListTestJSON-839456758 None] Created volume successfully. Apr 28 15:22:56 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1073741824" returned: 0 in 0.776s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:56 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:22:56 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:56 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 0.585s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.596s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Creating offline snapshot d372fcc3-8d40-48f2-aebd-701f502396a7 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c2945-a733-456f-bf02-f7959cc949df]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Attempting download of e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad5bdd-3a24-4aba-a240-178dc6128075]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:56 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 Apr 28 15:22:56 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:56 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq Apr 28 15:22:56 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:57 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846" returned: 0 in 0.711s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:57 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 1G Apr 28 15:22:57 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:57 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq" returned: 0 in 0.713s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:57 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq Apr 28 15:22:57 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:58 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 1G" returned: 0 in 0.752s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:58 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:22:58 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:58 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq" returned: 1 in 0.745s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_2rgxczsq' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[569069f8-3428-4475-9aae-8b62931e984a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:58 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD Apr 28 15:22:58 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:58 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.615s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:58 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 is being set with open permissions: ugo+rw Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:58 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:22:58 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:58 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e was qcow2, converting to raw {{(pid=84270) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 15:22:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:58 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:22:58 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:22:59 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 28 15:22:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.602s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:22:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:22:59 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info Apr 28 15:22:59 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:00 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info" returned: 0 in 0.676s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:00 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info is being set with open permissions: ugo+rw Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:00 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info Apr 28 15:23:00 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:00 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.info" returned: 0 in 0.668s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-eff90acd-9d1d-4075-93d0-1a8d41445706 tempest-VolumesSnapshotListTestJSON-839456758 None] Create snapshot completed successfully Apr 28 15:23:00 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 1.871s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e_nttm5ko6devstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:23:00 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Converted 112.00 MB image at 59.82 MB/s Apr 28 15:23:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:00 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1G Apr 28 15:23:00 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Creating offline snapshot 00070863-9f95-4ce3-9a03-ddb36aa53737 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:23:01 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 1G" returned: 0 in 0.668s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701129b-eac9-4712-9cfe-e3f08974de3c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[336cab59-46e1-458a-ade1-b069add00016]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:01 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:23:01 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:01 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:01 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:02 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.751s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:02 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 0.741s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:02 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 1G Apr 28 15:23:02 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:02 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:02 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:03 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:03 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 1G" returned: 0 in 0.764s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 1 in 0.750s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Downloaded image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}])) to volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 successfully. {{(pid=84270) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Temporary image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e for user b253e68ff5454e5bacf5d8a1abd930e3 is deleted. {{(pid=84270) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.volume_utils [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Marking volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 as bootable. {{(pid=84270) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 15:23:03 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:03 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Copying metadata from image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e to 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8. {{(pid=84270) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Creating volume glance metadata for volume 6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 backed by image e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84270) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f0478a-cd63-42d5-9c56-69d2985ad4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8', 'volume_size': 1, 'image_id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71dbdad587464cf1a25b2316af4b3b31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e', 'created_at': datetime.datetime(2026, 4, 28, 13, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 13, 8, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8094f-1fb4-41a5-b3c2-7bd9eae2201e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cbbf37-3650-4ff9-9b92-6ddd0f7b6842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Volume volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 (6c98b9f4-fd8c-4442-bf35-f4e37bae27a8): created successfully Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cbbf37-3650-4ff9-9b92-6ddd0f7b6842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Flow 'volume_create_manager' (f5774749-0b78-4b8d-b361-db3b8498c185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-6cb091e7-9312-4473-8d08-19ef580a9b6e tempest-VolumesExtendTest-990938301 None] Created volume successfully. Apr 28 15:23:03 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.668s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:03 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 is being set with open permissions: ugo+rw Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:03 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:03 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:04 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.604s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.332s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a6ab8621-46fb-47f2-b390-171727e6e29c tempest-VolumesSnapshotListTestJSON-839456758 None] Create snapshot completed successfully Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb47a3-e6b5-4a10-b3ea-58e43af07298]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:04 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:04 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:05 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 0.699s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:05 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:05 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:05 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 1 in 0.697s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 2G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 2G" returned: 0 in 0.054s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.491s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.053s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Creating offline snapshot c95c5762-9bc6-4f4c-93bf-60393952eb51 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea2772-cbaa-4f64-bcc2-5cf7c8683b81]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2eec937f-e1e3-46ab-8a4c-3d0f5e290e32 tempest-VolumesExtendTest-990938301 None] Extend volume completed successfully. Apr 28 15:23:05 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:05 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "cinder-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-quobyte-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd73eea-9182-4cfa-b3d7-33f4fc051d36]: (4, 'raw') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:06 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:06 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:06 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:06 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 1G Apr 28 15:23:06 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:07 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 0.731s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:07 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:07 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:07 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 1G" returned: 0 in 0.819s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:07 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 Apr 28 15:23:07 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:07 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 1 in 0.715s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8' failed. Not Retrying. {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 15:23:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:07 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8 Apr 28 15:23:07 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:08 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51" returned: 0 in 0.638s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:08 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 is being set with open permissions: ugo+rw Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:08 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 Apr 28 15:23:08 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:08 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" returned: 0 in 0.617s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8" released by "delete_volume" :: held 2.146s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Created reservations ['40819d01-8a47-4433-b454-4370cc4056c3', 'e44f9189-b0b0-441c-bff9-43385bfe9afc', '6cdb43ee-f528-46ce-b951-9ddb3fb8a026', '11c04ea0-9f91-46bc-a411-a6bcd6870a9a'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:08 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51" returned: 0 in 0.627s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:08 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:08 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.908s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3ae11b49-7f22-4caa-8eab-448db873922c tempest-VolumesSnapshotListTestJSON-839456758 None] Create snapshot completed successfully Apr 28 15:23:09 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.628s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:09 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Deleted volume successfully. Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fafd9eb5-5cef-46f8-84a2-0c7ff4f395c0 tempest-VolumesExtendTest-990938301 None] Lock "cinder-6c98b9f4-fd8c-4442-bf35-f4e37bae27a8-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-c95c5762-9bc6-4f4c-93bf-60393952eb51-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-c95c5762-9bc6-4f4c-93bf-60393952eb51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-c95c5762-9bc6-4f4c-93bf-60393952eb51" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-c95c5762-9bc6-4f4c-93bf-60393952eb51" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Deleting offline snapshot c95c5762-9bc6-4f4c-93bf-60393952eb51 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] snapshot_file for this snap is: volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a478b7-5592-465a-8d7d-6e8fcf7e5860]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:09 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 Apr 28 15:23:09 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Flow 'volume_create_manager' (584ebe71-6fb9-4fc9-9193-5f5660a58f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5db660b-6900-4f86-8215-b4eae4c34d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5db660b-6900-4f86-8215-b4eae4c34d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1082010394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2b5fa0-0802-42cb-bc7f-944d84986d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2dd1e0829e43bdbc898c386546a5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:10Z,use_quota=True,user_id='b253e68ff5454e5bacf5d8a1abd930e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b55e94-8c57-46ea-bc91-a0a69f595cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b55e94-8c57-46ea-bc91-a0a69f595cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d84a8b-5516-48ec-884e-159c1d6eb30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d84a8b-5516-48ec-884e-159c1d6eb30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2b5fa0-0802-42cb-bc7f-944d84986d54', 'volume_name': 'volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110b55be-81bb-475e-bc88-151256ed9d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110b55be-81bb-475e-bc88-151256ed9d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff9d346-8205-4dc4-99ad-a0d2d007eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:10 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Volume 4a2b5fa0-0802-42cb-bc7f-944d84986d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54', 'volume_size': 1} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1082010394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2b5fa0-0802-42cb-bc7f-944d84986d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2dd1e0829e43bdbc898c386546a5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:10Z,use_quota=True,user_id='b253e68ff5454e5bacf5d8a1abd930e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Creating volume 4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:23:10 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:10 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 1073741824 Apr 28 15:23:10 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:10 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51" returned: 0 in 0.725s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[98210bd9-b8cf-4275-92ca-1939234e48da]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:10 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:10 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:10 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 1073741824" returned: 0 in 0.774s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:10 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:10 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:11 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:11 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 Apr 28 15:23:11 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:11 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.609s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff9d346-8205-4dc4-99ad-a0d2d007eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e975d1a-ff16-45e9-9ed1-f90edceb6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:11 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Volume volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 (4a2b5fa0-0802-42cb-bc7f-944d84986d54): created successfully Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e975d1a-ff16-45e9-9ed1-f90edceb6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Flow 'volume_create_manager' (584ebe71-6fb9-4fc9-9193-5f5660a58f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:11 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0ed84368-af59-43e0-be57-c0cb29975048 tempest-VolumesExtendTest-990938301 None] Created volume successfully. Apr 28 15:23:11 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51" returned: 0 in 0.755s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:12 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51 Apr 28 15:23:12 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Creating offline snapshot 577c71c3-d270-4028-bc79-9bb889bb552d of volume 4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151e6e2-ba6e-4314-83ac-2dea98be8298]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:12 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:12 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:12 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.c95c5762-9bc6-4f4c-93bf-60393952eb51" returned: 0 in 0.601s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-c95c5762-9bc6-4f4c-93bf-60393952eb51" released by "_delete_snapshot" :: held 2.950s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" released by "delete_snapshot" :: held 2.974s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Created reservations ['2add5e57-560c-4bb9-96b3-f73172506dd1', '21d58c52-c394-4fe2-a2de-efe8d5882ff6', 'a340110f-f550-44eb-83f9-b94089b95c04', 'c7eb4da2-1c60-4bad-a671-2570256053c3'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Delete snapshot completed successfully. Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-9ede6a97-7f5c-4c51-a5c2-4961ace94ea7 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-c95c5762-9bc6-4f4c-93bf-60393952eb51-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-00070863-9f95-4ce3-9a03-ddb36aa53737-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-00070863-9f95-4ce3-9a03-ddb36aa53737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-00070863-9f95-4ce3-9a03-ddb36aa53737" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-00070863-9f95-4ce3-9a03-ddb36aa53737" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Deleting offline snapshot 00070863-9f95-4ce3-9a03-ddb36aa53737 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] snapshot_file for this snap is: volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0f3b0-3b67-4c9d-9af8-bbb095ec7a6e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:13 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:13 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:13 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:13 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d 1G Apr 28 15:23:13 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:13 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.750s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfbcc73-ff1b-41f5-bd96-985de2ac0c41]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:13 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:23:13 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:13 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d 1G" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:13 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d Apr 28 15:23:13 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:14 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:14 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:14 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:14 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d" returned: 0 in 0.681s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:14 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d is being set with open permissions: ugo+rw Apr 28 15:23:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:14 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d Apr 28 15:23:14 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:15 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.750s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:15 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737 Apr 28 15:23:15 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:15 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d" returned: 0 in 0.633s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:15 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info Apr 28 15:23:15 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:15 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.00070863-9f95-4ce3-9a03-ddb36aa53737" returned: 0 in 0.584s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-00070863-9f95-4ce3-9a03-ddb36aa53737" released by "_delete_snapshot" :: held 2.863s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" released by "delete_snapshot" :: held 2.889s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Created reservations ['ce9b2361-25ab-49d3-9599-a30e9887efc9', '114782cf-f025-4ea3-9070-0aeb010a21fd', 'ecaf15c1-c0d4-4c4f-b046-c8384f2b266f', '0e416624-002b-4609-a464-67fd95e54672'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:15 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info" returned: 0 in 0.609s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:15 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info is being set with open permissions: ugo+rw Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:15 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Delete snapshot completed successfully. Apr 28 15:23:15 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info Apr 28 15:23:15 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3065a1ad-a20a-4cf9-86dc-096480290013 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-00070863-9f95-4ce3-9a03-ddb36aa53737-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-d372fcc3-8d40-48f2-aebd-701f502396a7-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-d372fcc3-8d40-48f2-aebd-701f502396a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-d372fcc3-8d40-48f2-aebd-701f502396a7" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-d372fcc3-8d40-48f2-aebd-701f502396a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Deleting offline snapshot d372fcc3-8d40-48f2-aebd-701f502396a7 of volume 998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] snapshot_file for this snap is: volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9853b51a-96cf-4ca2-a178-378b108bd8e5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:16 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:23:16 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:16 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.info" returned: 0 in 0.575s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.086s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-10ca1605-bf37-4b09-9342-f05fcde84ed6 tempest-VolumesExtendTest-990938301 None] Create snapshot completed successfully Apr 28 15:23:16 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.703s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998760c1-cc77-4b2c-957e-55714a827846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aeb611-10b6-436f-9c3e-ef35775df3e9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:16 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 Apr 28 15:23:16 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:17 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:17 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:23:17 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7515af48-82cf-4ade-bd37-445c649c9cfa]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:17 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:17 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:18 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.697s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:18 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7 Apr 28 15:23:18 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:18 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d 2G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d 2G" returned: 0 in 0.111s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.870s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-74c74b0d-0a6d-47af-adf0-5965944592f7 tempest-VolumesExtendTest-990938301 None] Extend volume completed successfully. Apr 28 15:23:18 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846.d372fcc3-8d40-48f2-aebd-701f502396a7" returned: 0 in 0.617s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-d372fcc3-8d40-48f2-aebd-701f502396a7" released by "_delete_snapshot" :: held 2.820s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-577c71c3-d270-4028-bc79-9bb889bb552d-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" released by "delete_snapshot" :: held 2.845s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-577c71c3-d270-4028-bc79-9bb889bb552d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-quobyte-577c71c3-d270-4028-bc79-9bb889bb552d" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-577c71c3-d270-4028-bc79-9bb889bb552d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Deleting offline snapshot 577c71c3-d270-4028-bc79-9bb889bb552d of volume 4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:23:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] snapshot_file for this snap is: volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b19cce-ed68-4750-8a5f-c0427ba52188]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Created reservations ['da5ee094-2e47-48c4-bcc8-642f86023591', '3c5a2c30-45f5-4b65-986b-19ada789c190', '4523a21b-4e6c-4919-bf9c-c6b7b29aa821', 'c460111b-e1ea-4538-96f7-57d9701e034e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Delete snapshot completed successfully. Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1d327e3a-5e07-4c86-bd2f-4ab70b83e888 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-d372fcc3-8d40-48f2-aebd-701f502396a7-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:19 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d Apr 28 15:23:19 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-998760c1-cc77-4b2c-957e-55714a827846-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-998760c1-cc77-4b2c-957e-55714a827846-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc35e49-a179-4a04-8086-6c4ce330a399]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:19 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 Apr 28 15:23:19 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:19 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d" returned: 0 in 0.707s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0290c8-d261-4546-b5e3-96c7bb6eaf4e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:19 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:19 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:20 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846" returned: 0 in 0.739s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:20 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846 Apr 28 15:23:20 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:20 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.685s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:20 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d Apr 28 15:23:20 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:20 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-998760c1-cc77-4b2c-957e-55714a827846" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-quobyte-998760c1-cc77-4b2c-957e-55714a827846" released by "delete_volume" :: held 1.423s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Created reservations ['ed5e4140-e6f2-41e7-ab9f-eb6beafa3e8f', '87a9ddeb-86f6-43e6-81b6-790ae3ca5ef2', '152a1e54-383c-40c5-bca2-db6a6fa0ba44', '34a2ea14-6891-4a8e-b864-eae979b38221'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:20 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:20 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:21 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:21 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d Apr 28 15:23:21 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:21 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.601s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Deleted volume successfully. Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-dcfd4ff4-14c1-4927-9273-fa64271e9c39 tempest-VolumesSnapshotListTestJSON-839456758 None] Lock "cinder-998760c1-cc77-4b2c-957e-55714a827846-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:21 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54.577c71c3-d270-4028-bc79-9bb889bb552d" returned: 0 in 0.643s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-577c71c3-d270-4028-bc79-9bb889bb552d" released by "_delete_snapshot" :: held 2.868s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" released by "delete_snapshot" :: held 2.895s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Created reservations ['ac857509-34bd-4b87-9822-46be95cae2f3', 'e43c6231-2b9a-469c-a8cc-ccfe15b80c44', 'aabc6299-2814-4565-ba6d-acfb6684cf64', '30dff256-ec6b-41e0-8248-4ee96b610528'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Delete snapshot completed successfully. Apr 28 15:23:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-71cc4e77-992b-4c41-acbc-fdf2db5ae3f9 tempest-VolumesExtendTest-990938301 None] Lock "cinder-577c71c3-d270-4028-bc79-9bb889bb552d-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-4a2b5fa0-0802-42cb-bc7f-944d84986d54-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "cinder-4a2b5fa0-0802-42cb-bc7f-944d84986d54-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Acquiring lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14bed0b-0ba0-4a39-b702-544a9d7e19f9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:22 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:22 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:23 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.779s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:23 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54 Apr 28 15:23:23 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:23 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4a2b5fa0-0802-42cb-bc7f-944d84986d54" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "cinder-quobyte-4a2b5fa0-0802-42cb-bc7f-944d84986d54" released by "delete_volume" :: held 1.505s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Created reservations ['057d2985-268f-446a-9238-6cbdc429cdcf', '6e7e547c-344f-453c-837f-8ea87b2b905a', 'b794515f-3e54-475d-ba26-42c0237bde5e', 'cbd22eff-cb61-44ae-bdaf-0581da378d6b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:23 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:23 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Flow 'volume_create_manager' (4f3ac3a7-7b93-4f46-8a60-c5168119a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb71a60-94e8-4222-ba8b-8caca727a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:24 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb71a60-94e8-4222-ba8b-8caca727a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64676a5dcfa48c69a241cd3deb37712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:25Z,use_quota=True,user_id='bb8705f20840456f88faffdd225d581b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6e0998-149f-42e7-80e0-b3f41b4a742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6e0998-149f-42e7-80e0-b3f41b4a742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2516f8-38c9-4e41-9ecc-dea3e7c2905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2516f8-38c9-4e41-9ecc-dea3e7c2905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a', 'volume_name': 'volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c257fcb-7dac-44f1-9804-c620d3f4d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c257fcb-7dac-44f1-9804-c620d3f4d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c298a69-0fbe-4d15-900b-a7dce7796879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:24 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Volume 25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a', 'volume_size': 1} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64676a5dcfa48c69a241cd3deb37712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:25Z,use_quota=True,user_id='bb8705f20840456f88faffdd225d581b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Creating volume 25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:23:24 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.742s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:24 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Deleted volume successfully. Apr 28 15:23:24 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a 1073741824 Apr 28 15:23:24 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a65c8f85-7964-43bd-8611-9abbbc7cd7af tempest-VolumesExtendTest-990938301 None] Lock "cinder-4a2b5fa0-0802-42cb-bc7f-944d84986d54-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:25 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a 1073741824" returned: 0 in 0.845s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:25 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a Apr 28 15:23:25 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:26 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" returned: 0 in 0.640s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c298a69-0fbe-4d15-900b-a7dce7796879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89c02f1-6d09-402c-a53a-fa09366efee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:26 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Volume volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a (25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a): created successfully Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89c02f1-6d09-402c-a53a-fa09366efee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:26 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Flow 'volume_create_manager' (4f3ac3a7-7b93-4f46-8a60-c5168119a604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2907d125-7067-4f72-9cdd-fd17309d1427 tempest-CinderUnicodeTest-2118939086 None] Created volume successfully. Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Flow 'volume_create_manager' (0dc56301-7ae4-434d-bd4c-3f1d295c5a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca19cd-0fa7-43df-8898-5428b42440f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca19cd-0fa7-43df-8898-5428b42440f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-392898132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a08acb-f789-42c0-be38-3544b5891c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64676a5dcfa48c69a241cd3deb37712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:27Z,use_quota=True,user_id='bb8705f20840456f88faffdd225d581b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52066147-ee48-49c5-9e2c-0a9cc5ce45cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52066147-ee48-49c5-9e2c-0a9cc5ce45cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365cd308-d2ba-4597-961a-734266e6c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365cd308-d2ba-4597-961a-734266e6c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a08acb-f789-42c0-be38-3544b5891c53', 'volume_name': 'volume-c4a08acb-f789-42c0-be38-3544b5891c53', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4310a3-f54e-454d-80e9-e14ca45c5b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4310a3-f54e-454d-80e9-e14ca45c5b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b925992-b91f-4fc6-bc39-8a348e788a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Volume c4a08acb-f789-42c0-be38-3544b5891c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a08acb-f789-42c0-be38-3544b5891c53', 'volume_size': 1} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-392898132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a08acb-f789-42c0-be38-3544b5891c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64676a5dcfa48c69a241cd3deb37712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:27Z,use_quota=True,user_id='bb8705f20840456f88faffdd225d581b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Creating volume c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:23:27 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:27 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 1073741824 Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:23:27 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Flow 'volume_create_manager' (b29c6b9d-6df0-4f44-a38c-a82ca8d0aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7a6d49-bf52-460a-814c-486db7b934ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7a6d49-bf52-460a-814c-486db7b934ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1355701143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83736f9a-d596-4c4c-8150-f366d447463d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0072c77ec54addbf9a171aa4b2852e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:27Z,use_quota=True,user_id='28cb491c7d374f0fa18f83d5d7f89bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e9f5e3-5a6f-4727-a04a-2583f62e9fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e9f5e3-5a6f-4727-a04a-2583f62e9fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd9210-abb6-4dc5-a3b7-e9586790ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd9210-abb6-4dc5-a3b7-e9586790ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83736f9a-d596-4c4c-8150-f366d447463d', 'volume_name': 'volume-83736f9a-d596-4c4c-8150-f366d447463d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2e90cb-5f65-4a07-b9af-29cb4798f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2e90cb-5f65-4a07-b9af-29cb4798f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc1d73-343a-49e0-a585-5c1a0866df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Volume 83736f9a-d596-4c4c-8150-f366d447463d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83736f9a-d596-4c4c-8150-f366d447463d', 'volume_size': 1} Apr 28 15:23:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:28 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 1073741824" returned: 0 in 0.757s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:28 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 Apr 28 15:23:28 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:28 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53" returned: 0 in 0.612s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1355701143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83736f9a-d596-4c4c-8150-f366d447463d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0072c77ec54addbf9a171aa4b2852e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:23:27Z,use_quota=True,user_id='28cb491c7d374f0fa18f83d5d7f89bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Creating volume 83736f9a-d596-4c4c-8150-f366d447463d {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:23:28 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b925992-b91f-4fc6-bc39-8a348e788a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a08acb-f789-42c0-be38-3544b5891c53', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:28 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d 1073741824 Apr 28 15:23:28 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04548d95-d71c-4b76-a78a-d526360ccfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:28 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Volume volume-c4a08acb-f789-42c0-be38-3544b5891c53 (c4a08acb-f789-42c0-be38-3544b5891c53): created successfully Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04548d95-d71c-4b76-a78a-d526360ccfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:28 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Flow 'volume_create_manager' (0dc56301-7ae4-434d-bd4c-3f1d295c5a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-dce74be8-c6b3-4e15-b962-d3b5528f8974 tempest-CinderUnicodeTest-2118939086 None] Created volume successfully. Apr 28 15:23:29 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d 1073741824" returned: 0 in 0.785s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:29 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d Apr 28 15:23:29 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:30 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d" returned: 0 in 0.571s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.545s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc1d73-343a-49e0-a585-5c1a0866df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83736f9a-d596-4c4c-8150-f366d447463d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5176f-f78f-4839-afd6-92828228de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Creating offline snapshot a3dbb6ae-ac2d-432c-a283-9d8b9e131139 of volume c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:23:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Volume volume-83736f9a-d596-4c4c-8150-f366d447463d (83736f9a-d596-4c4c-8150-f366d447463d): created successfully Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5176f-f78f-4839-afd6-92828228de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Flow 'volume_create_manager' (b29c6b9d-6df0-4f44-a38c-a82ca8d0aea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[88401204-ca58-4920-be63-450c35d58a05]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:30 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cbeb098c-31c4-438e-9014-edbcc5b407d3 tempest-VolumesNegativeTest-2043147837 None] Created volume successfully. Apr 28 15:23:30 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 Apr 28 15:23:30 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:30 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53" returned: 0 in 0.734s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:30 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 1G Apr 28 15:23:30 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:31 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 1G" returned: 0 in 0.818s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a08acb-f789-42c0-be38-3544b5891c53 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:31 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a08acb-f789-42c0-be38-3544b5891c53 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 Apr 28 15:23:31 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:32 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a08acb-f789-42c0-be38-3544b5891c53 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:32 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 is being set with open permissions: ugo+rw Apr 28 15:23:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:32 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 Apr 28 15:23:32 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:33 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139" returned: 0 in 0.640s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:33 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info Apr 28 15:23:33 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:33 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info" returned: 0 in 0.606s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:33 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info is being set with open permissions: ugo+rw Apr 28 15:23:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:33 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info Apr 28 15:23:33 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:34 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.info" returned: 0 in 0.592s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.126s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:34 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f353421e-2816-4590-99aa-06f4e6a42835 tempest-CinderUnicodeTest-2118939086 None] Create snapshot completed successfully Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-a3dbb6ae-ac2d-432c-a283-9d8b9e131139-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-a3dbb6ae-ac2d-432c-a283-9d8b9e131139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-quobyte-a3dbb6ae-ac2d-432c-a283-9d8b9e131139" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-a3dbb6ae-ac2d-432c-a283-9d8b9e131139" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Deleting offline snapshot a3dbb6ae-ac2d-432c-a283-9d8b9e131139 of volume c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] snapshot_file for this snap is: volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaeb332-ea4d-457a-b161-3bef14a4a99f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:35 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 Apr 28 15:23:35 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:35 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139" returned: 0 in 0.717s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a08acb-f789-42c0-be38-3544b5891c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:23:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cea933-cb01-40fb-861d-d2c383f91c05]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:35 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 Apr 28 15:23:35 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:36 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53" returned: 0 in 0.782s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:36 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 Apr 28 15:23:36 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:37 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139" returned: 0 in 0.819s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:37 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139 Apr 28 15:23:37 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:37 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53.a3dbb6ae-ac2d-432c-a283-9d8b9e131139" returned: 0 in 0.630s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-a3dbb6ae-ac2d-432c-a283-9d8b9e131139" released by "_delete_snapshot" :: held 3.060s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" released by "delete_snapshot" :: held 3.087s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:38 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Created reservations ['64d3c96f-2106-4e74-b213-5bf63b9ceef9', 'df7e403c-cd66-4375-aea2-a102a185b7b1', 'eff97c4c-7b21-4550-8821-3675aab5c7eb', '45d33c87-c35a-4268-8f79-79a06c80d0f8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:38 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Delete snapshot completed successfully. Apr 28 15:23:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-72dd8f4b-ef3c-4eff-8082-68596953a53f tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-a3dbb6ae-ac2d-432c-a283-9d8b9e131139-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-c4a08acb-f789-42c0-be38-3544b5891c53-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-c4a08acb-f789-42c0-be38-3544b5891c53-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fafa7d3-de00-418d-8791-e1fd45b0adb5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:39 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 Apr 28 15:23:39 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:39 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53" returned: 0 in 0.763s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:39 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53 Apr 28 15:23:39 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:40 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-c4a08acb-f789-42c0-be38-3544b5891c53" returned: 0 in 0.613s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-c4a08acb-f789-42c0-be38-3544b5891c53" released by "delete_volume" :: held 1.432s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Created reservations ['baaa5927-c40b-4207-95de-b8faf75fcafe', '8620d773-a620-4bfa-b47d-7a1c5c70359e', '4105e70d-a19b-44bb-adfe-b3a15bb54e50', '7f7b6e33-ed7c-49f5-8f79-d28fa039983b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:40 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:40 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:41 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.652s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Deleted volume successfully. Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "cinder-quobyte-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-43c11898-dea5-489b-8f57-73167957be48 tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-c4a08acb-f789-42c0-be38-3544b5891c53-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fbdf98-240f-42ab-9fcd-17e09e97e6b6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:41 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a Apr 28 15:23:41 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:42 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" returned: 0 in 0.737s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:42 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a Apr 28 15:23:42 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:42 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" returned: 0 in 0.591s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-quobyte-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a" released by "delete_volume" :: held 1.368s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Created reservations ['03e2edf8-198e-4278-8e9d-43ab4b94d808', 'd65bd4d4-21bb-4f69-9f78-1a96861a262f', '279f3dc9-883c-45d1-b95f-45b3533517d9', 'a5016f18-a3c1-4db7-8903-5d4bd31e3c4d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:43 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:43 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:43 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.971s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:43 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Deleted volume successfully. Apr 28 15:23:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-04d09525-f551-4b7c-8dd7-724f9bde746c tempest-CinderUnicodeTest-2118939086 None] Lock "cinder-25487ee4-bfac-4907-bfa9-dfd5a1dd1c3a-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:50 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:50 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:51 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.602s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:23:52 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:UPDATE=104,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:23:53 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=91,cinder:SELECT=92,cinder:INSERT=33,cinder:DELETE=8 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Acquiring lock "cinder-83736f9a-d596-4c4c-8150-f366d447463d-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "cinder-83736f9a-d596-4c4c-8150-f366d447463d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Acquiring lock "cinder-quobyte-83736f9a-d596-4c4c-8150-f366d447463d" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "cinder-quobyte-83736f9a-d596-4c4c-8150-f366d447463d" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c658d1a-27b5-4007-9a1c-35f4c80b442f]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:58 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d Apr 28 15:23:58 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:58 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d" returned: 0 in 0.719s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:59 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d Apr 28 15:23:59 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:23:59 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83736f9a-d596-4c4c-8150-f366d447463d" returned: 0 in 0.673s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "cinder-quobyte-83736f9a-d596-4c4c-8150-f366d447463d" released by "delete_volume" :: held 1.432s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Created reservations ['397df816-85ed-41c4-8bdb-fea8095e1807', 'beae584f-617e-4b02-98a4-015daefe687d', 'be9aa8d4-9d56-4c6c-b57d-10c49b57dffa', '4b17be34-0047-4fc2-a30a-b58fa1beed21'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:23:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:23:59 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:23:59 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:00 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.619s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:00 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:24:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Deleted volume successfully. Apr 28 15:24:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7a8d5925-828c-4f23-9962-9bc5598de47b tempest-VolumesNegativeTest-2043147837 None] Lock "cinder-83736f9a-d596-4c4c-8150-f366d447463d-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:09 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (03285c37-1d0b-48d6-9983-50c93f68a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab7f187-1c96-4d74-8dc5-560455ad0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab7f187-1c96-4d74-8dc5-560455ad0415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041739643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea2f730-9b8b-4672-997b-4da61b20e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:10Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12d3dae-d556-4f8a-867c-f96ded0581de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12d3dae-d556-4f8a-867c-f96ded0581de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56472d64-6fec-4a2f-b079-4e0e7ad48f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56472d64-6fec-4a2f-b079-4e0e7ad48f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea2f730-9b8b-4672-997b-4da61b20e483', 'volume_name': 'volume-eea2f730-9b8b-4672-997b-4da61b20e483', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b41cebd-42bb-463b-a0b5-4bf5066b604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b41cebd-42bb-463b-a0b5-4bf5066b604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f212914-bdc1-48ab-9dcc-bf501ea1e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:10 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume eea2f730-9b8b-4672-997b-4da61b20e483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea2f730-9b8b-4672-997b-4da61b20e483', 'volume_size': 1} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041739643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea2f730-9b8b-4672-997b-4da61b20e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:10Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Creating volume eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:24:10 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:24:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:10 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 1073741824 Apr 28 15:24:10 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:11 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 1073741824" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:11 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 Apr 28 15:24:11 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:11 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483" returned: 0 in 0.585s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f212914-bdc1-48ab-9dcc-bf501ea1e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea2f730-9b8b-4672-997b-4da61b20e483', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313b5fc9-3d7f-416a-9e0f-0fbbb6346953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:11 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume volume-eea2f730-9b8b-4672-997b-4da61b20e483 (eea2f730-9b8b-4672-997b-4da61b20e483): created successfully Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313b5fc9-3d7f-416a-9e0f-0fbbb6346953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:11 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (03285c37-1d0b-48d6-9983-50c93f68a70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:11 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-9c8bef36-cd87-49d4-80d8-5d3359534073 tempest-VolumesSnapshotTestJSON-1366673902 None] Created volume successfully. Apr 28 15:24:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Creating offline snapshot 38275fcc-8427-4c4e-ac7a-f9ecc760bad7 of volume eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:24:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c56c2-f779-44cb-bd75-1740a48c70c5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:12 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 Apr 28 15:24:12 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:13 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483" returned: 0 in 0.732s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:13 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 1G Apr 28 15:24:13 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:14 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 1G" returned: 0 in 0.726s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea2f730-9b8b-4672-997b-4da61b20e483 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:14 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea2f730-9b8b-4672-997b-4da61b20e483 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 Apr 28 15:24:14 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:14 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea2f730-9b8b-4672-997b-4da61b20e483 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7" returned: 0 in 0.670s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:14 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 is being set with open permissions: ugo+rw Apr 28 15:24:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:14 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 Apr 28 15:24:14 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:15 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7" returned: 0 in 0.585s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:15 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info Apr 28 15:24:15 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:16 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:16 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info is being set with open permissions: ugo+rw Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:16 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info Apr 28 15:24:16 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:16 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.info" returned: 0 in 0.584s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4302bf58-0662-4ecd-8e37-d3b121f4ad5e tempest-VolumesSnapshotTestJSON-1366673902 None] Create snapshot completed successfully Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-38275fcc-8427-4c4e-ac7a-f9ecc760bad7-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-38275fcc-8427-4c4e-ac7a-f9ecc760bad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-38275fcc-8427-4c4e-ac7a-f9ecc760bad7" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-38275fcc-8427-4c4e-ac7a-f9ecc760bad7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Deleting offline snapshot 38275fcc-8427-4c4e-ac7a-f9ecc760bad7 of volume eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] snapshot_file for this snap is: volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8178e870-e0a7-401d-afea-ec85385185ed]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:17 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 Apr 28 15:24:17 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:17 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7" returned: 0 in 0.683s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea2f730-9b8b-4672-997b-4da61b20e483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df8863-fcef-45ee-933b-85159b9e9285]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:17 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 Apr 28 15:24:17 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:18 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483" returned: 0 in 0.700s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:18 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 Apr 28 15:24:18 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:19 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7" returned: 0 in 0.679s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:19 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7 Apr 28 15:24:19 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:19 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483.38275fcc-8427-4c4e-ac7a-f9ecc760bad7" returned: 0 in 0.583s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-38275fcc-8427-4c4e-ac7a-f9ecc760bad7" released by "_delete_snapshot" :: held 2.743s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" released by "delete_snapshot" :: held 2.762s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['bcf51cf4-85eb-4c6c-916a-3ea21e34fa7e', 'ed2cfe9d-af1e-4c5c-85bc-dbc75be81917', 'ae45ea21-daa8-4158-bef3-560e1647677d', 'ef7cb680-ce8a-4a05-8441-40e8059ff656'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:24:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Delete snapshot completed successfully. Apr 28 15:24:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-70dbe867-2eec-416b-968d-f4a0eae9ce27 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-38275fcc-8427-4c4e-ac7a-f9ecc760bad7-delete_snapshot" released by "delete_snapshot" :: held 2.918s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (40f22e27-5a41-4f55-b69e-8404645fe851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8696daaa-72ab-43ec-8afa-ef883e21c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8696daaa-72ab-43ec-8afa-ef883e21c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2059143703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1581feb-a906-465f-9764-e16ca2f90af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:20Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea522deb-f8df-46fe-80f6-e3385a64a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea522deb-f8df-46fe-80f6-e3385a64a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c09e292-230e-4315-9533-8ca4867f2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c09e292-230e-4315-9533-8ca4867f2141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1581feb-a906-465f-9764-e16ca2f90af2', 'volume_name': 'volume-a1581feb-a906-465f-9764-e16ca2f90af2', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f65210f-015b-4681-be4f-6466807fa32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f65210f-015b-4681-be4f-6466807fa32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f95eb9-5f92-445e-8a99-1cc1f171d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:20 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume a1581feb-a906-465f-9764-e16ca2f90af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1581feb-a906-465f-9764-e16ca2f90af2', 'volume_size': 1} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2059143703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1581feb-a906-465f-9764-e16ca2f90af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:20Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Creating volume a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:24:20 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:24:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:20 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 1073741824 Apr 28 15:24:20 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:21 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 1073741824" returned: 0 in 0.770s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:21 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:21 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:21 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.579s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f95eb9-5f92-445e-8a99-1cc1f171d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1581feb-a906-465f-9764-e16ca2f90af2', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5598b59-2930-4de7-952c-d8d5043e3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume volume-a1581feb-a906-465f-9764-e16ca2f90af2 (a1581feb-a906-465f-9764-e16ca2f90af2): created successfully Apr 28 15:24:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5598b59-2930-4de7-952c-d8d5043e3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (40f22e27-5a41-4f55-b69e-8404645fe851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0ddfe91c-dded-4458-a402-b0e66c9a79e7 tempest-VolumesSnapshotTestJSON-1366673902 None] Created volume successfully. Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Creating offline snapshot c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af of volume a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfddedca-20d1-49a4-b4fa-8e3b68f3227d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:22 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:22 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:23 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:23 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af 1G Apr 28 15:24:23 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:24 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af 1G" returned: 0 in 0.746s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1581feb-a906-465f-9764-e16ca2f90af2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:24 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1581feb-a906-465f-9764-e16ca2f90af2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:24 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:24 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1581feb-a906-465f-9764-e16ca2f90af2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.621s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:24 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af is being set with open permissions: ugo+rw Apr 28 15:24:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:24 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:24 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:25 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.577s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:25 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info Apr 28 15:24:25 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:26 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info" returned: 0 in 0.603s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:26 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info is being set with open permissions: ugo+rw Apr 28 15:24:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:26 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info Apr 28 15:24:26 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:26 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.info" returned: 0 in 0.582s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c18b08c6-4f6a-4e01-adaf-ec77f238213b tempest-VolumesSnapshotTestJSON-1366673902 None] Create snapshot completed successfully Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (9eedb6df-586f-4b08-a7b7-f37e98414e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317f27b8-fddd-4e9e-8a67-c7142bce3d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317f27b8-fddd-4e9e-8a67-c7142bce3d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-890498571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7bc4fd-d963-4e9b-90f2-6e284743835b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:27Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c36a557-952c-472a-9c0b-f6fa44484c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c36a557-952c-472a-9c0b-f6fa44484c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b6a151-8e8b-4171-be61-b11e0e0e4b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b6a151-8e8b-4171-be61-b11e0e0e4b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc7bc4fd-d963-4e9b-90f2-6e284743835b', 'volume_name': 'volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b', 'volume_size': 2, 'snapshot_id': 'c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7650cdb-c2ec-4226-a95c-b8c33ebc0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7650cdb-c2ec-4226-a95c-b8c33ebc0e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da14e06a-948e-441e-bf2e-ac3d4f5fe202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume fc7bc4fd-d963-4e9b-90f2-6e284743835b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b', 'volume_size': 2, 'snapshot_id': 'c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af'} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-fc7bc4fd-d963-4e9b-90f2-6e284743835b" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-fc7bc4fd-d963-4e9b-90f2-6e284743835b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Creating volume fc7bc4fd-d963-4e9b-90f2-6e284743835b from snapshot c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] snapshot: c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af, volume: fc7bc4fd-d963-4e9b-90f2-6e284743835b, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2bfe6d-0718-46d1-8026-6871e22a9d87]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:27 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:27 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:28 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1581feb-a906-465f-9764-e16ca2f90af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc17594-cc91-49b0-b933-869a9ccf1a02]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:28 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:28 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:28 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.702s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:24:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:28 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b Apr 28 15:24:28 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:33 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b" returned: 0 in 4.336s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:33 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63d65dc-d255-4ea8-96aa-eb5da73f9dad]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:33 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:33 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:34 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.877s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:24:34 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Converted 1024.00 MB image at 236.01 MB/s Apr 28 15:24:34 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b is being set with open permissions: ugo+rw Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:34 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b Apr 28 15:24:34 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:34 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b" returned: 0 in 0.569s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" released by "_copy_volume_from_snapshot" :: held 7.285s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-fc7bc4fd-d963-4e9b-90f2-6e284743835b" released by "_create_volume_from_snapshot" :: held 7.313s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.328s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da14e06a-948e-441e-bf2e-ac3d4f5fe202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b', 'volume_size': 2, 'snapshot_id': 'c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3ec728-89cc-48b7-856c-8919fc66db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:34 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b (fc7bc4fd-d963-4e9b-90f2-6e284743835b): created successfully Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3ec728-89cc-48b7-856c-8919fc66db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:34 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (9eedb6df-586f-4b08-a7b7-f37e98414e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:34 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-21d7fe26-0a03-4f70-8db6-4e464d718389 tempest-VolumesSnapshotTestJSON-1366673902 None] Created volume successfully. Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-fc7bc4fd-d963-4e9b-90f2-6e284743835b-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-fc7bc4fd-d963-4e9b-90f2-6e284743835b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e79d2-48a8-40a0-9b61-3bef3e66fbc5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:35 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b Apr 28 15:24:35 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:35 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b" returned: 0 in 0.690s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:35 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b Apr 28 15:24:35 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:36 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc7bc4fd-d963-4e9b-90f2-6e284743835b" returned: 0 in 0.594s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-fc7bc4fd-d963-4e9b-90f2-6e284743835b" released by "delete_volume" :: held 1.323s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['96a0afa5-86f2-4fc6-8bed-f5dcd2a3e68b', '677cdc8c-b8a2-494c-bc7b-2673b7540ff8', '7b71bfeb-d562-4659-82be-8cbc3d4690c6', 'ecae94be-77a5-45c9-a5d6-e82069c9d608'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:36 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:24:36 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:37 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.614s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:24:37 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Deleted volume successfully. Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-18dfe863-71ba-4f21-b81b-391cc5cc4c5b tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-fc7bc4fd-d963-4e9b-90f2-6e284743835b-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Deleting offline snapshot c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af of volume a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] snapshot_file for this snap is: volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6abe09-63f2-4e8f-8961-d327a8d1445e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:37 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:37 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:38 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.699s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1581feb-a906-465f-9764-e16ca2f90af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042302a-0a2d-408f-bbd3-46fe4502a4c3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:38 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:38 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:38 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.728s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:38 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:38 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:39 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.702s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:39 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af Apr 28 15:24:39 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:40 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2.c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af" released by "_delete_snapshot" :: held 2.842s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" released by "delete_snapshot" :: held 2.865s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['d66d7aac-d3f1-49a0-815c-34f217a87302', 'e6bc29d5-222b-4064-8554-2e31f5e38caf', '7f3be05d-d5ac-45cf-a508-ee2438a6788b', 'dd72ed12-7137-4bd3-861c-11d2697eb470'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:24:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Delete snapshot completed successfully. Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-33e97302-709a-4873-8e3b-5ab29be773ae tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-c5bc02c6-3dc2-4a74-8507-51dbbeb5f3af-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-a1581feb-a906-465f-9764-e16ca2f90af2-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-a1581feb-a906-465f-9764-e16ca2f90af2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51eff3-404a-4e79-96e7-387d9d10cf38]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:40 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:40 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:41 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.714s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:41 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2 Apr 28 15:24:41 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:41 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a1581feb-a906-465f-9764-e16ca2f90af2" returned: 0 in 0.593s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:41 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-a1581feb-a906-465f-9764-e16ca2f90af2" released by "delete_volume" :: held 1.370s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:41 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['0c94b0f0-c718-4112-b405-fc0d3cf078df', '783ac665-338f-4f4b-a6e9-d9f74f97c61f', '4e32fe48-5bb3-47ad-9e72-cd8148c98957', 'd4a240a5-b3c8-49e5-9e59-1e491ae254c3'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:42 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:24:42 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:42 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.598s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:24:42 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Deleted volume successfully. Apr 28 15:24:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ab2b4ffa-97f1-4854-b546-1a50535d70d8 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-a1581feb-a906-465f-9764-e16ca2f90af2-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (24c2b2b7-db59-4896-9f12-866838108bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d767fc77-9634-49c6-bca6-39f8f3360a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d767fc77-9634-49c6-bca6-39f8f3360a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-775999015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83118446-a197-44bd-a807-9db840986fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:43Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b284e84e-5d08-4fac-a018-a922c157cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b284e84e-5d08-4fac-a018-a922c157cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26801404-09b4-4dc2-afb7-e60b42c4c424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26801404-09b4-4dc2-afb7-e60b42c4c424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83118446-a197-44bd-a807-9db840986fc4', 'volume_name': 'volume-83118446-a197-44bd-a807-9db840986fc4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb03651-aa7f-4be3-9216-075c5118bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb03651-aa7f-4be3-9216-075c5118bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1c6d4d-d5da-417f-9bf8-49c5fce74aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:43 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume 83118446-a197-44bd-a807-9db840986fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83118446-a197-44bd-a807-9db840986fc4', 'volume_size': 1} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-775999015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83118446-a197-44bd-a807-9db840986fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:43Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Creating volume 83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:24:43 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:24:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:43 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 1073741824 Apr 28 15:24:43 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:44 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 1073741824" returned: 0 in 0.766s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:44 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:24:44 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:44 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.593s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1c6d4d-d5da-417f-9bf8-49c5fce74aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83118446-a197-44bd-a807-9db840986fc4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed335d1-cbc7-4e2e-b241-5844e3faae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Volume volume-83118446-a197-44bd-a807-9db840986fc4 (83118446-a197-44bd-a807-9db840986fc4): created successfully Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed335d1-cbc7-4e2e-b241-5844e3faae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (24c2b2b7-db59-4896-9f12-866838108bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a3c7fb74-1144-422a-bef6-93fec926ced2 tempest-VolumesSnapshotTestJSON-1366673902 None] Created volume successfully. Apr 28 15:24:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Creating offline snapshot 9331b099-be36-4f49-8ad0-94f117867c29 of volume 83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:24:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2e6af6-6823-4f71-b073-045d951fccff]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:45 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:24:45 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:46 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.711s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:46 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 1G Apr 28 15:24:46 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:46 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 1G" returned: 0 in 0.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83118446-a197-44bd-a807-9db840986fc4 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:46 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83118446-a197-44bd-a807-9db840986fc4 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:24:46 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:47 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83118446-a197-44bd-a807-9db840986fc4 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.633s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:47 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 is being set with open permissions: ugo+rw Apr 28 15:24:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:47 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:24:47 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:48 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.613s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:48 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info Apr 28 15:24:48 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:48 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:48 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info is being set with open permissions: ugo+rw Apr 28 15:24:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:48 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info Apr 28 15:24:48 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:49 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.info" returned: 0 in 0.601s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.986s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:49 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-471f7516-4121-4d19-8c2e-884a7ecdc6dd tempest-VolumesSnapshotTestJSON-1366673902 None] Create snapshot completed successfully Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (c0009681-45ac-418f-aa4e-2b8971ae8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28674038-2784-4919-8cb3-3b519c683ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28674038-2784-4919-8cb3-3b519c683ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2093592458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999e19ab-efea-45b0-bb9a-e807abd0488f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5b9c69cbe4e30b4ef6a8385c0307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9331b099-be36-4f49-8ad0-94f117867c29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:24:50Z,use_quota=True,user_id='576bf046a0114a409c014bcfa3e44aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531375f2-e9c4-49d0-9b93-e376951d1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531375f2-e9c4-49d0-9b93-e376951d1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c1e683-c40d-456c-af7b-2d3f748e957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c1e683-c40d-456c-af7b-2d3f748e957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '999e19ab-efea-45b0-bb9a-e807abd0488f', 'volume_name': 'volume-999e19ab-efea-45b0-bb9a-e807abd0488f', 'volume_size': 1, 'snapshot_id': '9331b099-be36-4f49-8ad0-94f117867c29'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b60c08-afb4-4c02-8824-1b2c13ccd53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b60c08-afb4-4c02-8824-1b2c13ccd53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653dea68-731c-4685-b51f-432aa4938aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:50 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Volume 999e19ab-efea-45b0-bb9a-e807abd0488f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-999e19ab-efea-45b0-bb9a-e807abd0488f', 'volume_size': 1, 'snapshot_id': '9331b099-be36-4f49-8ad0-94f117867c29'} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29-999e19ab-efea-45b0-bb9a-e807abd0488f" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29-999e19ab-efea-45b0-bb9a-e807abd0488f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Creating volume 999e19ab-efea-45b0-bb9a-e807abd0488f from snapshot 9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] snapshot: 9331b099-be36-4f49-8ad0-94f117867c29, volume: 999e19ab-efea-45b0-bb9a-e807abd0488f, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bfd03-62ee-4c01-a336-b7267dd87d4e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:50 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:24:50 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:50 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:24:50 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:50 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.721s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83118446-a197-44bd-a807-9db840986fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6181ba56-1f4a-422e-b84a-4d43e94cc2fb]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:51 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:24:51 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:24:51 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:51 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.716s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:51 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:24:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:51 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f Apr 28 15:24:51 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:56 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f" returned: 0 in 4.414s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f24770-4958-45a0-9842-292475445f5e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:56 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:24:56 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:56 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.855s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:24:56 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Converted 1024.00 MB image at 231.92 MB/s Apr 28 15:24:56 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f is being set with open permissions: ugo+rw Apr 28 15:24:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:56 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f Apr 28 15:24:56 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:57 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f" returned: 0 in 0.591s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" released by "_copy_volume_from_snapshot" :: held 7.385s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29-999e19ab-efea-45b0-bb9a-e807abd0488f" released by "_create_volume_from_snapshot" :: held 7.414s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.429s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653dea68-731c-4685-b51f-432aa4938aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999e19ab-efea-45b0-bb9a-e807abd0488f', 'volume_size': 1, 'snapshot_id': '9331b099-be36-4f49-8ad0-94f117867c29'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1507d727-38e1-4e17-9367-cec4d55f2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=56,cinder:SELECT=48,cinder:INSERT=16,cinder:DELETE=6 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:24:57 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Volume volume-999e19ab-efea-45b0-bb9a-e807abd0488f (999e19ab-efea-45b0-bb9a-e807abd0488f): created successfully Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1507d727-38e1-4e17-9367-cec4d55f2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:24:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Flow 'volume_create_manager' (c0009681-45ac-418f-aa4e-2b8971ae8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:24:57 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e5104869-2605-46d4-94e1-f48dd19df57d tempest-VolumesSnapshotTestJSON-1366673902 None] Created volume successfully. Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-999e19ab-efea-45b0-bb9a-e807abd0488f-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-999e19ab-efea-45b0-bb9a-e807abd0488f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[db467058-9aa7-4bec-a8d5-125f70919f84]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:24:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:59 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f Apr 28 15:24:59 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:24:59 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 28 15:24:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f" returned: 0 in 0.691s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:24:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:24:59 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f Apr 28 15:24:59 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:00 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-999e19ab-efea-45b0-bb9a-e807abd0488f" returned: 0 in 0.573s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-999e19ab-efea-45b0-bb9a-e807abd0488f" released by "delete_volume" :: held 1.302s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['3517eb5e-f78b-4fc2-9f9a-77c4817c5e1e', '942fb348-cb50-46da-a187-3e5094c53251', '548e897d-3f25-4990-940e-cc6a6b8def95', '3b6ec0af-71e3-473d-804b-5f8fe6830168'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:00 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:00 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:00 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.600s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Deleted volume successfully. Apr 28 15:25:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8067377f-4b15-430c-8060-d66b05db01c3 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-999e19ab-efea-45b0-bb9a-e807abd0488f-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-9331b099-be36-4f49-8ad0-94f117867c29-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-9331b099-be36-4f49-8ad0-94f117867c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Deleting offline snapshot 9331b099-be36-4f49-8ad0-94f117867c29 of volume 83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] snapshot_file for this snap is: volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f209a2e-c7b9-4431-ad9b-0ba1eec826eb]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:01 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:25:01 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:01 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.696s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83118446-a197-44bd-a807-9db840986fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e830a0-6537-47f4-9422-0e06599bf3cd]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:01 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:25:01 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:02 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.715s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:02 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:25:02 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:03 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.704s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:03 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29 Apr 28 15:25:03 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:03 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4.9331b099-be36-4f49-8ad0-94f117867c29" returned: 0 in 0.599s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-9331b099-be36-4f49-8ad0-94f117867c29" released by "_delete_snapshot" :: held 2.812s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" released by "delete_snapshot" :: held 2.832s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:03 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['97a48001-5593-4722-982d-e6fdb951b605', '4ea97d07-5e35-401e-ad90-a7c004c0c571', 'caf63218-9a99-4266-924f-67c96291acdd', '8e928100-3b4f-47ee-afd5-3dc61a4cb286'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Delete snapshot completed successfully. Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b727c9d2-c185-4c51-93ad-59171d304c06 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-9331b099-be36-4f49-8ad0-94f117867c29-delete_snapshot" released by "delete_snapshot" :: held 2.958s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-83118446-a197-44bd-a807-9db840986fc4-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-83118446-a197-44bd-a807-9db840986fc4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39e3c7b-5bc9-449b-aed0-cf667332965b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:04 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:25:04 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:05 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.695s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:05 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4 Apr 28 15:25:05 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:05 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-83118446-a197-44bd-a807-9db840986fc4" returned: 0 in 0.574s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-83118446-a197-44bd-a807-9db840986fc4" released by "delete_volume" :: held 1.331s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['be6755dd-7584-431d-9ebb-e03eb03f4e6a', '4b143720-0d59-4339-a16d-9149893badb9', 'c0f7fa0c-63db-4f36-9759-843eb8fd980b', '42c40f3b-da71-455e-9bd8-de4872d522cb'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:05 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:05 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:06 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:06 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Deleted volume successfully. Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f424f92d-1d00-4e7f-9af3-66ad1ad6586f tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-83118446-a197-44bd-a807-9db840986fc4-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-eea2f730-9b8b-4672-997b-4da61b20e483-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-eea2f730-9b8b-4672-997b-4da61b20e483-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bd7502-e377-44f7-8fa1-97400f068761]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:06 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 Apr 28 15:25:06 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:07 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483" returned: 0 in 0.691s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:07 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483 Apr 28 15:25:07 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:07 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-eea2f730-9b8b-4672-997b-4da61b20e483" returned: 0 in 0.590s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:07 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-quobyte-eea2f730-9b8b-4672-997b-4da61b20e483" released by "delete_volume" :: held 1.333s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Created reservations ['a0fae19e-9cb9-435e-bb5f-54ba449c42ef', '90a0f845-b5a0-4272-b844-d82b4e134024', '05a06090-8f6e-4ed8-a61d-22bf6f2d5675', '35934a05-c00f-4bb9-ae14-dec31931d13d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:08 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:08 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:08 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.580s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Deleted volume successfully. Apr 28 15:25:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3acd7358-c501-40bb-932f-efe4244220b9 tempest-VolumesSnapshotTestJSON-1366673902 None] Lock "cinder-eea2f730-9b8b-4672-997b-4da61b20e483-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=77,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=6 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (90c2e312-ac72-48a5-9861-544a1aa3dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e17320-e3fe-4eb2-808a-91199d6bb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e17320-e3fe-4eb2-808a-91199d6bb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973123201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:14Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7005c23-6a36-432b-8bbb-4684a1fea759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7005c23-6a36-432b-8bbb-4684a1fea759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef7053f-f55a-49a5-8608-866ea60f7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef7053f-f55a-49a5-8608-866ea60f7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4', 'volume_name': 'volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ada27e5-39bb-4f79-b0e0-04afd8a94772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ada27e5-39bb-4f79-b0e0-04afd8a94772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd92051f-f9b4-4b5d-bbad-716ddfb69e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:14 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume 9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4', 'volume_size': 1} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973123201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:14Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume 9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:14 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:14 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 1073741824 Apr 28 15:25:14 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:14 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 1073741824" returned: 0 in 0.779s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:14 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 Apr 28 15:25:14 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:15 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" returned: 0 in 0.582s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd92051f-f9b4-4b5d-bbad-716ddfb69e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e29b4-9aee-49be-b029-6cff2073fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:15 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 (9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4): created successfully Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e29b4-9aee-49be-b029-6cff2073fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:15 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (90c2e312-ac72-48a5-9861-544a1aa3dae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:15 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a183a4cb-d8bd-4501-b798-81d8776409ce tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (da76df28-a990-4b55-883b-47f4a7655ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aab12e0-ea15-4e17-8810-5d52e8bf3e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aab12e0-ea15-4e17-8810-5d52e8bf3e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537026333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b240d5-bf5d-400c-82a9-d99a3a12b781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:16Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0fff4-2dbb-445d-9feb-ae2326652321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0fff4-2dbb-445d-9feb-ae2326652321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1f38b8-e87c-4889-ae00-03f30210eaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1f38b8-e87c-4889-ae00-03f30210eaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b240d5-bf5d-400c-82a9-d99a3a12b781', 'volume_name': 'volume-58b240d5-bf5d-400c-82a9-d99a3a12b781', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47679956-51ab-459b-9522-e175ae3320af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47679956-51ab-459b-9522-e175ae3320af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba09d633-047d-4371-a13c-6e4578481fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume 58b240d5-bf5d-400c-82a9-d99a3a12b781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b240d5-bf5d-400c-82a9-d99a3a12b781', 'volume_size': 1} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537026333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b240d5-bf5d-400c-82a9-d99a3a12b781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:16Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume 58b240d5-bf5d-400c-82a9-d99a3a12b781 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:16 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:16 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 1073741824 Apr 28 15:25:16 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (7b5a43ed-3a95-4366-bd06-58d80b416c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5658b67-1073-4a31-80ec-2814a3ef93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5658b67-1073-4a31-80ec-2814a3ef93fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725551410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2d998b-20b5-4aad-b856-84210a00d746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4006406c-5060-476c-b027-7a47041e3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4006406c-5060-476c-b027-7a47041e3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10448149-e259-4ca8-adf7-9ba279811f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10448149-e259-4ca8-adf7-9ba279811f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2d998b-20b5-4aad-b856-84210a00d746', 'volume_name': 'volume-df2d998b-20b5-4aad-b856-84210a00d746', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a03460-eb61-45b5-9e2f-38c02d82f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a03460-eb61-45b5-9e2f-38c02d82f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b89f36d-ede5-43e4-9609-49661378b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:16 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume df2d998b-20b5-4aad-b856-84210a00d746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2d998b-20b5-4aad-b856-84210a00d746', 'volume_size': 1} Apr 28 15:25:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (19ac7771-84c9-4fa7-8379-649f8cc51604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3e54b-0811-4549-97ac-052ef244a856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3e54b-0811-4549-97ac-052ef244a856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2137500832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac83b6af-fe0f-450c-86e3-19ebe189f4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcccc24d-3e2f-47dc-84da-765e51931345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcccc24d-3e2f-47dc-84da-765e51931345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ca6988-f0e1-4330-a0df-10df72fa0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ca6988-f0e1-4330-a0df-10df72fa0d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac83b6af-fe0f-450c-86e3-19ebe189f4ea', 'volume_name': 'volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83975d7c-db66-473d-a410-e48faf9da3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83975d7c-db66-473d-a410-e48faf9da3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c53e51e-4657-4a5f-a2b9-0dfdc83e540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume ac83b6af-fe0f-450c-86e3-19ebe189f4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea', 'volume_size': 1} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:17 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 1073741824" returned: 0 in 0.945s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (c8cb1da1-d55f-4ca2-b246-fb03c4924b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e25f058-6e1e-4fff-8778-2690d873ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e25f058-6e1e-4fff-8778-2690d873ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71315071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fac41a7-7bb5-4536-a7d6-62f520fe60af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1263ec2f-9d25-40d6-8e27-6709c1f02fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1263ec2f-9d25-40d6-8e27-6709c1f02fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56803a-6428-40df-be69-81dded9fd5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56803a-6428-40df-be69-81dded9fd5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fac41a7-7bb5-4536-a7d6-62f520fe60af', 'volume_name': 'volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b32c10c-2c0f-40ff-9645-caafcb724469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b32c10c-2c0f-40ff-9645-caafcb724469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc4558-cbea-4a95-b9d1-4c8a77798361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume 0fac41a7-7bb5-4536-a7d6-62f520fe60af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af', 'volume_size': 1} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:17 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 Apr 28 15:25:17 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (9453e675-3050-4980-8898-603eec34e7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23173d48-5dcd-4cbd-8ec3-a73070e08fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23173d48-5dcd-4cbd-8ec3-a73070e08fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777550257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81659b9-d638-4a17-b599-126ec88eaece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:18Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093235d7-0bfa-47e2-88c7-26b5aa08006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093235d7-0bfa-47e2-88c7-26b5aa08006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a28604-a4a4-4a15-85e5-4d588abce82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a28604-a4a4-4a15-85e5-4d588abce82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81659b9-d638-4a17-b599-126ec88eaece', 'volume_name': 'volume-d81659b9-d638-4a17-b599-126ec88eaece', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcf25da-c1b3-49bd-afc6-a079227a54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcf25da-c1b3-49bd-afc6-a079227a54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6292fb6-6f6b-4ecb-9cf1-05461a288ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume d81659b9-d638-4a17-b599-126ec88eaece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81659b9-d638-4a17-b599-126ec88eaece', 'volume_size': 1} Apr 28 15:25:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:18 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781" returned: 0 in 0.594s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725551410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2d998b-20b5-4aad-b856-84210a00d746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume df2d998b-20b5-4aad-b856-84210a00d746 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:18 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba09d633-047d-4371-a13c-6e4578481fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b240d5-bf5d-400c-82a9-d99a3a12b781', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ce142d-4b0f-41cd-bc5b-a3589ffe017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:18 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 1073741824 Apr 28 15:25:18 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:18 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 (58b240d5-bf5d-400c-82a9-d99a3a12b781): created successfully Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ce142d-4b0f-41cd-bc5b-a3589ffe017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (da76df28-a990-4b55-883b-47f4a7655ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-2d59fd79-3365-40f6-87b7-3f05b653f06b tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:19 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 1073741824" returned: 0 in 0.757s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:19 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 Apr 28 15:25:19 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:19 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746" returned: 0 in 0.586s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2137500832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac83b6af-fe0f-450c-86e3-19ebe189f4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume ac83b6af-fe0f-450c-86e3-19ebe189f4ea {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:19 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:19 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea 1073741824 Apr 28 15:25:19 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b89f36d-ede5-43e4-9609-49661378b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2d998b-20b5-4aad-b856-84210a00d746', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34b3c79-e9aa-4513-a6cf-d80a465abf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:19 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-df2d998b-20b5-4aad-b856-84210a00d746 (df2d998b-20b5-4aad-b856-84210a00d746): created successfully Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34b3c79-e9aa-4513-a6cf-d80a465abf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (7b5a43ed-3a95-4366-bd06-58d80b416c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3e9ecd06-31eb-4f9e-b014-a65f8d50b104 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:20 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea 1073741824" returned: 0 in 0.752s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:20 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea Apr 28 15:25:20 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:21 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" returned: 0 in 0.586s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.387s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71315071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fac41a7-7bb5-4536-a7d6-62f520fe60af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:17Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume 0fac41a7-7bb5-4536-a7d6-62f520fe60af {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:21 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:21 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af 1073741824 Apr 28 15:25:21 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c53e51e-4657-4a5f-a2b9-0dfdc83e540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7e8b70-cb48-4dd9-88c4-92116ed1d46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea (ac83b6af-fe0f-450c-86e3-19ebe189f4ea): created successfully Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7e8b70-cb48-4dd9-88c4-92116ed1d46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (19ac7771-84c9-4fa7-8379-649f8cc51604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-75390fa2-0c7d-4f78-9c1a-490f5ea1d8af tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:21 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af 1073741824" returned: 0 in 0.769s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:21 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af Apr 28 15:25:21 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:22 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.488s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777550257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81659b9-d638-4a17-b599-126ec88eaece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da809ae5ae24ecf95e67260322bee43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:18Z,use_quota=True,user_id='43c3cd3b8c904afca35612dcf0e5bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Creating volume d81659b9-d638-4a17-b599-126ec88eaece {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:22 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc4558-cbea-4a95-b9d1-4c8a77798361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:22 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece 1073741824 Apr 28 15:25:22 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1d240d-b384-419b-b547-1b4a125c183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af (0fac41a7-7bb5-4536-a7d6-62f520fe60af): created successfully Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1d240d-b384-419b-b547-1b4a125c183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (c8cb1da1-d55f-4ca2-b246-fb03c4924b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ec2ce043-29ef-44e3-8d7d-e56c07c95384 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:23 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece 1073741824" returned: 0 in 0.773s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:23 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece Apr 28 15:25:23 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:23 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6292fb6-6f6b-4ecb-9cf1-05461a288ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81659b9-d638-4a17-b599-126ec88eaece', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c7a41a-9e95-4909-ba25-3bf1f76326ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:23 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Volume volume-d81659b9-d638-4a17-b599-126ec88eaece (d81659b9-d638-4a17-b599-126ec88eaece): created successfully Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c7a41a-9e95-4909-ba25-3bf1f76326ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Flow 'volume_create_manager' (9453e675-3050-4980-8898-603eec34e7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:23 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e7dc73ae-83e9-4c5f-80da-70f2ae763496 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created volume successfully. Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-d81659b9-d638-4a17-b599-126ec88eaece-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-d81659b9-d638-4a17-b599-126ec88eaece-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-d81659b9-d638-4a17-b599-126ec88eaece" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-d81659b9-d638-4a17-b599-126ec88eaece" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8789f-caf6-4ae1-a6bf-439dcfce09ae]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:24 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece Apr 28 15:25:24 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:25 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece" returned: 0 in 0.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:25 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece Apr 28 15:25:25 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:25 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d81659b9-d638-4a17-b599-126ec88eaece" returned: 0 in 0.604s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-d81659b9-d638-4a17-b599-126ec88eaece" released by "delete_volume" :: held 1.397s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:25 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['6a8f3edd-16ba-4407-8363-c1d926f7c3a5', '86105e0a-e5e9-4721-ab6a-90f4e710c64d', '43c470c4-39a3-45bc-ae5b-e7f370651d9f', '4bee5897-407d-4a4d-9c73-0b274730b035'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:26 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:26 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:26 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-0fac41a7-7bb5-4536-a7d6-62f520fe60af-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.663s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-0fac41a7-7bb5-4536-a7d6-62f520fe60af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-8c1b33fd-6f3f-4050-971f-36b3a1549f1c tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-d81659b9-d638-4a17-b599-126ec88eaece-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-0fac41a7-7bb5-4536-a7d6-62f520fe60af" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-0fac41a7-7bb5-4536-a7d6-62f520fe60af" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43240b-2b09-4c4f-a8be-ef1587867d8a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:26 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af Apr 28 15:25:26 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:27 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af" returned: 0 in 0.685s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:27 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af Apr 28 15:25:27 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:28 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-0fac41a7-7bb5-4536-a7d6-62f520fe60af" returned: 0 in 0.602s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-0fac41a7-7bb5-4536-a7d6-62f520fe60af" released by "delete_volume" :: held 1.324s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['3a268671-ea07-4812-82c7-48dd1c61d8c5', 'e6e2003c-1bef-49be-b75e-24adce1ca735', '5058b105-2dda-476e-ab58-9e23935f8741', '59946f3f-764d-4b39-b505-d92f8893473d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:28 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:28 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:28 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.585s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:28 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-1606a17f-1e24-45cc-8bf5-d6645ef61d73 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-0fac41a7-7bb5-4536-a7d6-62f520fe60af-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-ac83b6af-fe0f-450c-86e3-19ebe189f4ea-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-ac83b6af-fe0f-450c-86e3-19ebe189f4ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:29 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc163bfd-d072-40e8-b2b7-996da28f1e1c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:29 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea Apr 28 15:25:29 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:29 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" returned: 0 in 0.699s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:29 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea Apr 28 15:25:29 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:30 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" returned: 0 in 0.590s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-ac83b6af-fe0f-450c-86e3-19ebe189f4ea" released by "delete_volume" :: held 1.328s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['9d3adaa7-184e-4422-b47e-0602617d3c49', '34a2fe45-0cd3-41a7-89c4-91e74c2d144b', '546faced-2c2f-4c18-bc76-876308c2b5dd', '63a9f001-dba2-4a37-9daa-e441929a3c54'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:30 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:30 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:31 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.574s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:31 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b59edb37-c2ab-483a-8dc8-6634ed548f72 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-ac83b6af-fe0f-450c-86e3-19ebe189f4ea-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-df2d998b-20b5-4aad-b856-84210a00d746-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-df2d998b-20b5-4aad-b856-84210a00d746-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-df2d998b-20b5-4aad-b856-84210a00d746" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-df2d998b-20b5-4aad-b856-84210a00d746" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59437f8-aeaf-43fd-8cb0-b98196791a57]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:31 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 Apr 28 15:25:31 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:31 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:31 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746 Apr 28 15:25:31 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:32 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-df2d998b-20b5-4aad-b856-84210a00d746" returned: 0 in 0.598s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-df2d998b-20b5-4aad-b856-84210a00d746" released by "delete_volume" :: held 1.344s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['00622905-b8de-4c14-9481-42f806be3036', 'ea6693b2-5664-4aad-8d07-85c75b26ffb2', '27ec6be1-7b5a-42df-a60d-8532d9d38ca3', '40170679-29fd-49a1-bd66-6995d8c9256e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:32 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:32 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:33 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.599s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:33 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7cee07da-5cb4-43b0-afc3-8af996c53003 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-df2d998b-20b5-4aad-b856-84210a00d746-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-58b240d5-bf5d-400c-82a9-d99a3a12b781-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-58b240d5-bf5d-400c-82a9-d99a3a12b781-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-58b240d5-bf5d-400c-82a9-d99a3a12b781" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-58b240d5-bf5d-400c-82a9-d99a3a12b781" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eae5c0-67f1-493f-9360-73aed109e462]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:33 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 Apr 28 15:25:33 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:34 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781" returned: 0 in 0.709s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:34 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781 Apr 28 15:25:34 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:34 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-58b240d5-bf5d-400c-82a9-d99a3a12b781" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-58b240d5-bf5d-400c-82a9-d99a3a12b781" released by "delete_volume" :: held 1.336s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['d7bc5088-94ba-44df-b215-a3d636f54d5f', '04aea8ed-ce02-4615-8be5-5f256e63f1ab', '1cdafe0e-e3cc-45a3-9787-42e926e2bc57', 'a1173acb-3715-41fe-9031-991cc83ba216'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:34 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:34 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:35 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.595s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f807bdc5-9fa1-409d-b58b-62065390e309 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-58b240d5-bf5d-400c-82a9-d99a3a12b781-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "cinder-quobyte-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f871a-42f7-4de1-9fe5-52c258c148e7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:35 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 Apr 28 15:25:35 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:36 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" returned: 0 in 0.691s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:36 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4 Apr 28 15:25:36 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:36 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-quobyte-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4" released by "delete_volume" :: held 1.347s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Created reservations ['87a537e5-7ddc-4455-bbb7-9302aa655aa7', 'f73b5511-89ce-4cf3-bcc9-4ba25d42c8a9', 'cc097e39-ef0b-438a-8073-9119a0696df2', '24c0e55e-3072-4323-ba62-b5bdf650768e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:37 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:37 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:37 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.573s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:37 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Deleted volume successfully. Apr 28 15:25:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c08be59f-3870-4f97-90f9-2b6e36c03b16 tempest-CreateVolumesFromSourceVolumeTest-31556394 None] Lock "cinder-9bcbbe46-f4fd-4a70-b398-e6bfdbe80cc4-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (a8a8fc92-aaea-44bd-80f9-3ee3717ce04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75c3bbf-4586-449c-8d75-08eb38887f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75c3bbf-4586-449c-8d75-08eb38887f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-271098186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890e8893-d6ee-4039-854d-0d8feaee8a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:40Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2b0027-b180-48ec-bdb7-f6d1dbb09572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2b0027-b180-48ec-bdb7-f6d1dbb09572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bb499d-c490-4446-9dfe-2131f9db1943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bb499d-c490-4446-9dfe-2131f9db1943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890e8893-d6ee-4039-854d-0d8feaee8a63', 'volume_name': 'volume-890e8893-d6ee-4039-854d-0d8feaee8a63', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55e9869-5c13-4581-9808-7f5b4e9fb94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55e9869-5c13-4581-9808-7f5b4e9fb94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3c2f0e-9a48-4073-b7ba-7a7118933612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:40 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Volume 890e8893-d6ee-4039-854d-0d8feaee8a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890e8893-d6ee-4039-854d-0d8feaee8a63', 'volume_size': 1} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-271098186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890e8893-d6ee-4039-854d-0d8feaee8a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:40Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Creating volume 890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:40 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:25:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:40 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 1073741824 Apr 28 15:25:40 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:41 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 1073741824" returned: 0 in 0.777s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:41 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:41 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:41 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.596s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3c2f0e-9a48-4073-b7ba-7a7118933612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890e8893-d6ee-4039-854d-0d8feaee8a63', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01741ed4-a9a5-4ff5-8e79-a774b0f92e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:41 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Volume volume-890e8893-d6ee-4039-854d-0d8feaee8a63 (890e8893-d6ee-4039-854d-0d8feaee8a63): created successfully Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01741ed4-a9a5-4ff5-8e79-a774b0f92e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (a8a8fc92-aaea-44bd-80f9-3ee3717ce04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-47cb99a0-26e4-4b78-a916-2999405b2a23 tempest-VolumeDependencyTests-1269085457 None] Created volume successfully. Apr 28 15:25:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Creating offline snapshot 74c07182-2386-45f7-9f68-19b777131b7a of volume 890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:25:42 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c906119-6648-4390-85f5-95c74d69c777]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:42 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:42 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:43 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.696s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:43 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a 1G Apr 28 15:25:43 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:44 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a 1G" returned: 0 in 0.741s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890e8893-d6ee-4039-854d-0d8feaee8a63 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:44 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890e8893-d6ee-4039-854d-0d8feaee8a63 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:44 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:44 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890e8893-d6ee-4039-854d-0d8feaee8a63 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.643s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:44 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a is being set with open permissions: ugo+rw Apr 28 15:25:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:44 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:44 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:45 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:45 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info Apr 28 15:25:45 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:45 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info" returned: 0 in 0.598s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:45 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info is being set with open permissions: ugo+rw Apr 28 15:25:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:46 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info Apr 28 15:25:46 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:46 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.info" returned: 0 in 0.617s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.970s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-07b27a9d-8fdd-4818-8c00-b9fbe1fff288 tempest-VolumeDependencyTests-1269085457 None] Create snapshot completed successfully Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (5c21de52-ddd5-4322-95c7-30ebaaf2cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2e133f-5057-4068-a726-c9d57065dd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2e133f-5057-4068-a726-c9d57065dd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2141952713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a702a397-cb8f-4349-83e7-46efe72369d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74c07182-2386-45f7-9f68-19b777131b7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:25:47Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337b4956-6bce-49f8-93d4-570c8e703d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337b4956-6bce-49f8-93d4-570c8e703d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7273c256-4e11-491e-957e-38cb1c17d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7273c256-4e11-491e-957e-38cb1c17d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a702a397-cb8f-4349-83e7-46efe72369d2', 'volume_name': 'volume-a702a397-cb8f-4349-83e7-46efe72369d2', 'volume_size': 1, 'snapshot_id': '74c07182-2386-45f7-9f68-19b777131b7a'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23faa48b-7650-4cc0-9a00-2246dd08b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23faa48b-7650-4cc0-9a00-2246dd08b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c230f-f774-46ef-b124-88eac0beb295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:47 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Volume a702a397-cb8f-4349-83e7-46efe72369d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a702a397-cb8f-4349-83e7-46efe72369d2', 'volume_size': 1, 'snapshot_id': '74c07182-2386-45f7-9f68-19b777131b7a'} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a-a702a397-cb8f-4349-83e7-46efe72369d2" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a-a702a397-cb8f-4349-83e7-46efe72369d2" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Creating volume a702a397-cb8f-4349-83e7-46efe72369d2 from snapshot 74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] snapshot: 74c07182-2386-45f7-9f68-19b777131b7a, volume: a702a397-cb8f-4349-83e7-46efe72369d2, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[020fc458-e7b7-4444-98e3-0cb4aed235e8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:47 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:47 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:48 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.710s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-890e8893-d6ee-4039-854d-0d8feaee8a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa28a80-a084-46ff-82a3-8a0bdc7ce4d4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:48 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:48 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:48 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.754s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:25:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:48 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 Apr 28 15:25:48 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:50 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:25:50 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:52 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.631s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:25:53 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2" returned: 0 in 4.608s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d878f08-8f17-402c-92ba-849c66c08229]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:53 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:53 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:54 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.878s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:54 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:25:54 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Converted 1024.00 MB image at 222.15 MB/s Apr 28 15:25:54 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 is being set with open permissions: ugo+rw Apr 28 15:25:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:54 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 Apr 28 15:25:54 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:55 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2" returned: 0 in 0.611s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" released by "_copy_volume_from_snapshot" :: held 7.642s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a-a702a397-cb8f-4349-83e7-46efe72369d2" released by "_create_volume_from_snapshot" :: held 7.674s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.689s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c230f-f774-46ef-b124-88eac0beb295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a702a397-cb8f-4349-83e7-46efe72369d2', 'volume_size': 1, 'snapshot_id': '74c07182-2386-45f7-9f68-19b777131b7a'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d54ca5-2dda-44f3-b7a0-731828f0fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:25:55 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Volume volume-a702a397-cb8f-4349-83e7-46efe72369d2 (a702a397-cb8f-4349-83e7-46efe72369d2): created successfully Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d54ca5-2dda-44f3-b7a0-731828f0fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (5c21de52-ddd5-4322-95c7-30ebaaf2cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:25:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-59c368c3-d0a6-46ab-ac24-4f03421081cf tempest-VolumeDependencyTests-1269085457 None] Created volume successfully. Apr 28 15:25:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-74c07182-2386-45f7-9f68-19b777131b7a-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-74c07182-2386-45f7-9f68-19b777131b7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Deleting offline snapshot 74c07182-2386-45f7-9f68-19b777131b7a of volume 890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] snapshot_file for this snap is: volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[748880fe-69e1-43e7-9304-a38ae88fb7d5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:56 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:56 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:56 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.690s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-890e8893-d6ee-4039-854d-0d8feaee8a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d512af-4124-4139-8c59-3cba9448dcfc]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:56 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:56 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:57 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.686s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:57 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:57 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:58 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.695s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:58 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a Apr 28 15:25:58 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:58 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63.74c07182-2386-45f7-9f68-19b777131b7a" returned: 0 in 0.601s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=63,cinder:INSERT=24,cinder:UPDATE=110,cinder:DELETE=11 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-74c07182-2386-45f7-9f68-19b777131b7a" released by "_delete_snapshot" :: held 2.778s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" released by "delete_snapshot" :: held 2.801s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Created reservations ['f33a09b1-84ba-4731-9e27-485c69834fcd', '945f3509-babb-40d2-81ee-5b3579d5317c', '00257ebf-9675-47df-b5d8-e1c1e4252897', 'e36992ae-d524-4061-b1e5-99505667b5d4'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:25:58 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Delete snapshot completed successfully. Apr 28 15:25:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-93c06c6e-8913-444a-8969-7905a7ee0b45 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-74c07182-2386-45f7-9f68-19b777131b7a-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-890e8893-d6ee-4039-854d-0d8feaee8a63-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-890e8893-d6ee-4039-854d-0d8feaee8a63-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa3a747-8843-4e12-8095-6915b7c8362c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:25:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:25:59 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:25:59 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:25:59 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.720s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:00 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63 Apr 28 15:26:00 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:00 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-890e8893-d6ee-4039-854d-0d8feaee8a63" returned: 0 in 0.619s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-890e8893-d6ee-4039-854d-0d8feaee8a63" released by "delete_volume" :: held 1.395s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Created reservations ['10bb8f9e-87f7-4dee-a70e-77a064cfc404', 'bc2e20e6-0cce-40af-8208-214f0f51c084', '48e3a9a6-2968-4810-b262-d387f65b22e6', '15a71d69-59a9-4bad-8573-635b93aecc4d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:00 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:00 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:01 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.640s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Deleted volume successfully. Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b2f6a4c9-b4a9-4290-a073-bf91232c5e58 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-890e8893-d6ee-4039-854d-0d8feaee8a63-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (ac58ef35-80a3-4198-b282-650ece430d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dadb23-f78e-4744-96b1-68d0e788d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dadb23-f78e-4744-96b1-68d0e788d478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1477074779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6700454-e8c2-4f60-b28f-ecd9b76869ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:02Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692a3212-9b2c-43e1-af74-34984462df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692a3212-9b2c-43e1-af74-34984462df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a0619-3ed3-40f4-a683-9ae6244da610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a0619-3ed3-40f4-a683-9ae6244da610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'volume_name': 'volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a450176-14d9-4420-8926-eac5590956c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a450176-14d9-4420-8926-eac5590956c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db789349-ea7c-4d67-8936-cf0b51037ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Volume b6700454-e8c2-4f60-b28f-ecd9b76869ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'volume_size': 1} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1477074779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6700454-e8c2-4f60-b28f-ecd9b76869ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:02Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Creating volume b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:01 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:01 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac 1073741824 Apr 28 15:26:01 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:02 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac 1073741824" returned: 0 in 0.741s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:02 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:02 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:03 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db789349-ea7c-4d67-8936-cf0b51037ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2d8355-3268-466b-a435-09efe91deb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Volume volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac (b6700454-e8c2-4f60-b28f-ecd9b76869ac): created successfully Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2d8355-3268-466b-a435-09efe91deb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (ac58ef35-80a3-4198-b282-650ece430d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ceefa64f-a1f8-47bc-9455-fa358ba8d43b tempest-VolumeDependencyTests-1269085457 None] Created volume successfully. Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (e2a8007e-560f-4430-919f-cd61b0300655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a0edc7-b497-4965-a8d1-ee6c010916ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a0edc7-b497-4965-a8d1-ee6c010916ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1674219076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fabaa76-d27b-47d9-a21e-1ab17c43c34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75d5e0dd2246e4aa9a08e27d98c509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b6700454-e8c2-4f60-b28f-ecd9b76869ac,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:04Z,use_quota=True,user_id='c708e31d43344e02aee4a44cb43b97bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c81f0f-e670-40fe-8296-82c32a4c0e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c81f0f-e670-40fe-8296-82c32a4c0e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97396dd6-ee90-4966-899d-65c810c3dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97396dd6-ee90-4966-899d-65c810c3dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9fabaa76-d27b-47d9-a21e-1ab17c43c34c', 'volume_name': 'volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c', 'volume_size': 1, 'source_volid': 'b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cf1b09-aa1a-4fa6-929b-3c85cf572975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cf1b09-aa1a-4fa6-929b-3c85cf572975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16ef402-a587-4be9-a9f6-a4c303e6b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:04 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Volume 9fabaa76-d27b-47d9-a21e-1ab17c43c34c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c', 'volume_size': 1, 'source_volid': 'b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'source_volstatus': 'available'} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:04 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Cloning volume b6700454-e8c2-4f60-b28f-ecd9b76869ac to volume 9fabaa76-d27b-47d9-a21e-1ab17c43c34c Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Creating offline snapshot bb0979f2-43bf-4318-a8be-49cca1df8db2 of volume b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[051d4c99-1960-4424-8e66-f3a4e005845b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:04 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:04 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:05 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.702s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:05 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 1G Apr 28 15:26:05 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:05 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 1G" returned: 0 in 0.755s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:05 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:05 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:06 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.622s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:06 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 is being set with open permissions: ugo+rw Apr 28 15:26:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:06 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:06 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:07 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:07 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info Apr 28 15:26:07 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:07 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info" returned: 0 in 0.612s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:07 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info is being set with open permissions: ugo+rw Apr 28 15:26:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:07 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info Apr 28 15:26:07 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:08 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.info" returned: 0 in 0.578s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] snapshot: bb0979f2-43bf-4318-a8be-49cca1df8db2, volume: 9fabaa76-d27b-47d9-a21e-1ab17c43c34c, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d89184-3a82-4b09-9e38-60d5fc8a3bf8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:08 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:08 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:09 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.684s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[badb86e9-833f-4391-a516-90624e5106d5]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:09 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:09 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:09 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.699s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:26:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:09 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c Apr 28 15:26:09 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:14 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" returned: 0 in 4.611s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b293a-a87e-4f35-b817-0b10799d7d29]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:14 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:14 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:15 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.889s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:26:15 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Converted 1024.00 MB image at 222.03 MB/s Apr 28 15:26:15 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c is being set with open permissions: ugo+rw Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:15 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c Apr 28 15:26:15 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:15 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" returned: 0 in 0.571s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" released by "_copy_volume_from_snapshot" :: held 7.539s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=6,cinder:UPDATE=84 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-bb0979f2-43bf-4318-a8be-49cca1df8db2" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-bb0979f2-43bf-4318-a8be-49cca1df8db2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Deleting offline snapshot bb0979f2-43bf-4318-a8be-49cca1df8db2 of volume b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] snapshot_file for this snap is: volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc96856-2fe2-41cf-adc2-7baa3ee3788a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:16 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:16 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:16 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:26:16 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66296a7-8a3f-4e95-ba17-cefc03979df7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:16 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:16 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:17 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:26:17 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.706s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:17 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:17 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:18 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.692s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:18 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2 Apr 28 15:26:18 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:18 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac.bb0979f2-43bf-4318-a8be-49cca1df8db2" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-bb0979f2-43bf-4318-a8be-49cca1df8db2" released by "_delete_snapshot" :: held 2.829s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.436s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16ef402-a587-4be9-a9f6-a4c303e6b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c', 'volume_size': 1, 'source_volid': 'b6700454-e8c2-4f60-b28f-ecd9b76869ac', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab91493c-b8d2-4e77-9690-7ec2987f8baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:18 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Volume volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c (9fabaa76-d27b-47d9-a21e-1ab17c43c34c): created successfully Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab91493c-b8d2-4e77-9690-7ec2987f8baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:18 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Flow 'volume_create_manager' (e2a8007e-560f-4430-919f-cd61b0300655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-67144f82-ebbc-4a1e-b203-9b597e8c1e6a tempest-VolumeDependencyTests-1269085457 None] Created volume successfully. Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-b6700454-e8c2-4f60-b28f-ecd9b76869ac-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-b6700454-e8c2-4f60-b28f-ecd9b76869ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-b6700454-e8c2-4f60-b28f-ecd9b76869ac" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-b6700454-e8c2-4f60-b28f-ecd9b76869ac" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ed7c29-b090-4b06-aad1-d4fc2c7a2a6d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:19 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:19 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:20 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.701s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:20 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac Apr 28 15:26:20 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:20 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-b6700454-e8c2-4f60-b28f-ecd9b76869ac" returned: 0 in 0.597s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-b6700454-e8c2-4f60-b28f-ecd9b76869ac" released by "delete_volume" :: held 1.356s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Created reservations ['fea26cb6-b319-42a2-ae48-d63283ea9b4d', 'af489946-8d1e-4a30-87ee-aee6d4224011', 'ef8ddbad-747f-438d-b2e2-6fa6406d701f', '7f412183-4f48-4ca3-b078-3276f1f37b24'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:20 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:20 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:21 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.634s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:21 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Deleted volume successfully. Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5d5dbb48-6ab1-40ce-b5b6-89e6f26b51fb tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-b6700454-e8c2-4f60-b28f-ecd9b76869ac-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-9fabaa76-d27b-47d9-a21e-1ab17c43c34c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-9fabaa76-d27b-47d9-a21e-1ab17c43c34c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd53697-21c5-4eed-9c4f-349a4cc714b7]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:21 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c Apr 28 15:26:21 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:22 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" returned: 0 in 0.686s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:22 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c Apr 28 15:26:22 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:22 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" returned: 0 in 0.615s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-9fabaa76-d27b-47d9-a21e-1ab17c43c34c" released by "delete_volume" :: held 1.342s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Created reservations ['d1092e70-d7fe-45f8-8bac-69fe259bea03', '5ad22aec-f2fc-4d14-9e4b-96ff203fd660', '6ae49873-3f94-4d1a-bf52-006e39a67b78', '0b1fd2fc-6768-445c-84f9-b89a70a3cf02'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:23 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:23 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:23 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.594s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:23 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Deleted volume successfully. Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f945fb45-606c-4a3b-b615-b16a066e6e12 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-9fabaa76-d27b-47d9-a21e-1ab17c43c34c-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-a702a397-cb8f-4349-83e7-46efe72369d2-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-a702a397-cb8f-4349-83e7-46efe72369d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916fd03-1ef6-468a-a24f-8bbe396a8575]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:24 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 Apr 28 15:26:24 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:24 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2" returned: 0 in 0.731s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:24 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2 Apr 28 15:26:24 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:25 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-a702a397-cb8f-4349-83e7-46efe72369d2" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-quobyte-a702a397-cb8f-4349-83e7-46efe72369d2" released by "delete_volume" :: held 1.370s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Created reservations ['4515b13b-1f55-4940-87cf-4c38f3de9b4c', 'e7089318-321a-4c8a-96b8-bc86c05062ff', '23fcd040-7782-4c6a-bcde-bc88ce5dfde5', '143e6687-3640-4523-a443-829e6b9a687b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:25 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:25 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:26 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.614s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:26 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Deleted volume successfully. Apr 28 15:26:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b294745-4821-4a74-b347-fc3e37a53094 tempest-VolumeDependencyTests-1269085457 None] Lock "cinder-a702a397-cb8f-4349-83e7-46efe72369d2-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:35 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=29,cinder:SELECT=18,cinder:INSERT=7 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:26:36 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=4 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (e1f50c07-664c-4ca5-bce9-390524f8cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01ff5fd-c364-4aa6-8a6b-60ca5c0cf70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01ff5fd-c364-4aa6-8a6b-60ca5c0cf70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812581914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7bdfe-df27-43ff-9bd9-0ab20f73a696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:37Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1b89bc-6d50-40bb-873d-cd3913cd7184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1b89bc-6d50-40bb-873d-cd3913cd7184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a230d1-7aa3-400f-ba73-4386d22f5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a230d1-7aa3-400f-ba73-4386d22f5353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb7bdfe-df27-43ff-9bd9-0ab20f73a696', 'volume_name': 'volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a6182-866c-44a4-bdb5-8d84c59f9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a6182-866c-44a4-bdb5-8d84c59f9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716ea977-96e3-4b46-b5ad-e720a0e8d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume dfb7bdfe-df27-43ff-9bd9-0ab20f73a696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696', 'volume_size': 1} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812581914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7bdfe-df27-43ff-9bd9-0ab20f73a696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:37Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:37 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:37 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 1073741824 Apr 28 15:26:37 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (4bb434ac-6365-489d-a038-89f1a57b1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f4a2d9-1be6-4058-9c67-656037d18ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f4a2d9-1be6-4058-9c67-656037d18ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731683189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4284be-1038-447d-a9f3-dbc048ab3efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:37Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8784585-ca23-43e9-9b70-7ee39be7a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8784585-ca23-43e9-9b70-7ee39be7a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecd36bc-b82c-46a2-9bc1-36ede4eb1495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecd36bc-b82c-46a2-9bc1-36ede4eb1495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4284be-1038-447d-a9f3-dbc048ab3efd', 'volume_name': 'volume-4e4284be-1038-447d-a9f3-dbc048ab3efd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ebe5d-1412-4cd3-8596-36a91c1d6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ebe5d-1412-4cd3-8596-36a91c1d6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856c7fba-1b67-408e-8806-1d17a8b94b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Volume 4e4284be-1038-447d-a9f3-dbc048ab3efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4284be-1038-447d-a9f3-dbc048ab3efd', 'volume_size': 1} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (d6a0502f-ae93-4729-8840-ad015c42ed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfca220-d696-4430-8c07-0f1c3032b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfca220-d696-4430-8c07-0f1c3032b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1626025626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1e0b49-620a-49c0-8ec3-792e68072471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b470bc9-bc47-4f1d-a5aa-c37db56433b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b470bc9-bc47-4f1d-a5aa-c37db56433b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f06491-7e4b-4260-b717-5568acf8d034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f06491-7e4b-4260-b717-5568acf8d034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1e0b49-620a-49c0-8ec3-792e68072471', 'volume_name': 'volume-fe1e0b49-620a-49c0-8ec3-792e68072471', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cdaf79-6b39-45d5-9bba-b883c995f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cdaf79-6b39-45d5-9bba-b883c995f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa219f5-9e22-4668-a71c-739c6ec1660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Volume fe1e0b49-620a-49c0-8ec3-792e68072471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1e0b49-620a-49c0-8ec3-792e68072471', 'volume_size': 1} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (7c13680e-1259-4532-8c34-988dc14d9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3799f0-2d08-46b6-9249-8e6c95ac4dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3799f0-2d08-46b6-9249-8e6c95ac4dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-202950852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe454ca-993a-4108-866f-76d0c310865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0615534a-3a7a-459b-b93d-1cabf8b4bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0615534a-3a7a-459b-b93d-1cabf8b4bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f50984b-1d12-4e1e-919c-8f79dfa57087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f50984b-1d12-4e1e-919c-8f79dfa57087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe454ca-993a-4108-866f-76d0c310865f', 'volume_name': 'volume-cbe454ca-993a-4108-866f-76d0c310865f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70534e-2ed8-4663-8708-c8e9de1a0366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70534e-2ed8-4663-8708-c8e9de1a0366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c3413d-1809-4c85-bd44-49a9586c1979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Volume cbe454ca-993a-4108-866f-76d0c310865f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe454ca-993a-4108-866f-76d0c310865f', 'volume_size': 1} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (bc055f77-a5fa-47bf-9d61-26190c8e7334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb8d41-af75-42f4-b385-6e0cf9952616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb8d41-af75-42f4-b385-6e0cf9952616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432474047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b83fabd-2b48-4811-a260-c10480973a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa14a59c-48ff-4a78-8fad-f17cc1bd6977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa14a59c-48ff-4a78-8fad-f17cc1bd6977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72202160-312b-43cc-aea7-f4fb1b8fa184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72202160-312b-43cc-aea7-f4fb1b8fa184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b83fabd-2b48-4811-a260-c10480973a46', 'volume_name': 'volume-5b83fabd-2b48-4811-a260-c10480973a46', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d170d0-455f-474a-8a0e-1874c5ec6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d170d0-455f-474a-8a0e-1874c5ec6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62df1777-66c4-46ed-b5a0-ab32e17859ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Volume 5b83fabd-2b48-4811-a260-c10480973a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b83fabd-2b48-4811-a260-c10480973a46', 'volume_size': 1} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:38 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (2fcd64f9-1675-44f1-bcbe-cd375637960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c15487-2177-4f2e-9ee5-830057cb1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 1073741824" returned: 0 in 1.428s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:38 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c15487-2177-4f2e-9ee5-830057cb1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841257208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c338a25-387e-4bda-b1a2-53818fe24cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:39Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1b7494-536f-4b06-8f21-8c94a3f33fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1b7494-536f-4b06-8f21-8c94a3f33fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a038f9c-05c3-4e95-b717-3547f5de99de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a038f9c-05c3-4e95-b717-3547f5de99de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c338a25-387e-4bda-b1a2-53818fe24cb5', 'volume_name': 'volume-6c338a25-387e-4bda-b1a2-53818fe24cb5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a935f380-30ab-4961-b5d0-5618e317d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a935f380-30ab-4961-b5d0-5618e317d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41dd72c-87ce-4636-bdf5-b5e59a437c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Volume 6c338a25-387e-4bda-b1a2-53818fe24cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c338a25-387e-4bda-b1a2-53818fe24cb5', 'volume_size': 1} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:39 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 Apr 28 15:26:39 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (f0edba46-5efa-47b8-bc74-360c13148777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef632df8-03e1-403b-9861-ea8adba01f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef632df8-03e1-403b-9861-ea8adba01f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471203417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b52fa4-e037-4b45-a571-3e7849876e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:39Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc85845-a10b-4d8f-83c6-88e94c5f467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc85845-a10b-4d8f-83c6-88e94c5f467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd831b5-0a66-4a49-8460-af687933c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd831b5-0a66-4a49-8460-af687933c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b52fa4-e037-4b45-a571-3e7849876e6c', 'volume_name': 'volume-46b52fa4-e037-4b45-a571-3e7849876e6c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781df8c8-7da7-47c7-9112-5f7145c2b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781df8c8-7da7-47c7-9112-5f7145c2b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78f50b6-9401-49ba-9e2a-4eed17e1056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Volume 46b52fa4-e037-4b45-a571-3e7849876e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b52fa4-e037-4b45-a571-3e7849876e6c', 'volume_size': 1} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:39 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731683189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4284be-1038-447d-a9f3-dbc048ab3efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:37Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Creating volume 4e4284be-1038-447d-a9f3-dbc048ab3efd {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:39 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716ea977-96e3-4b46-b5ad-e720a0e8d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd 1073741824 Apr 28 15:26:39 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b5a3b7-bb00-4abc-8d8b-f0d85d2f52a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:39 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 (dfb7bdfe-df27-43ff-9bd9-0ab20f73a696): created successfully Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b5a3b7-bb00-4abc-8d8b-f0d85d2f52a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:39 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (e1f50c07-664c-4ca5-bce9-390524f8cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:39 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b68b6886-0a73-4734-9ed0-7cdc5571ff12 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:26:40 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd 1073741824" returned: 0 in 0.796s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:40 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd Apr 28 15:26:40 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:41 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd" returned: 0 in 0.783s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1626025626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1e0b49-620a-49c0-8ec3-792e68072471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Creating volume fe1e0b49-620a-49c0-8ec3-792e68072471 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:41 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856c7fba-1b67-408e-8806-1d17a8b94b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4284be-1038-447d-a9f3-dbc048ab3efd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:41 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 1073741824 Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855c1140-7bbd-45a5-b29b-842b1dafe771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:41 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:41 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Volume volume-4e4284be-1038-447d-a9f3-dbc048ab3efd (4e4284be-1038-447d-a9f3-dbc048ab3efd): created successfully Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855c1140-7bbd-45a5-b29b-842b1dafe771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:41 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (4bb434ac-6365-489d-a038-89f1a57b1a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:41 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-bbdc1997-3e08-44fd-ab12-70bd59462ae2 tempest-CreateVolumesFromImageTest-2100815432 None] Created volume successfully. Apr 28 15:26:42 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 1073741824" returned: 0 in 0.786s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:42 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 Apr 28 15:26:42 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:42 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471" returned: 0 in 0.732s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-202950852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe454ca-993a-4108-866f-76d0c310865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Creating volume cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:42 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:43 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f 1073741824 Apr 28 15:26:43 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa219f5-9e22-4668-a71c-739c6ec1660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1e0b49-620a-49c0-8ec3-792e68072471', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddab9c0c-f6c1-421e-8719-9eccce56668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:43 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Volume volume-fe1e0b49-620a-49c0-8ec3-792e68072471 (fe1e0b49-620a-49c0-8ec3-792e68072471): created successfully Apr 28 15:26:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddab9c0c-f6c1-421e-8719-9eccce56668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:43 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (d6a0502f-ae93-4729-8840-ad015c42ed3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-60fee498-103c-40d9-9b30-0040f908b7ae tempest-CreateVolumesFromImageTest-2100815432 None] Created volume successfully. Apr 28 15:26:43 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f 1073741824" returned: 0 in 0.980s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:44 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:26:44 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:44 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 0.625s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.082s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432474047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b83fabd-2b48-4811-a260-c10480973a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:38Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Creating volume 5b83fabd-2b48-4811-a260-c10480973a46 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:44 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:44 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 1073741824 Apr 28 15:26:44 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c3413d-1809-4c85-bd44-49a9586c1979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe454ca-993a-4108-866f-76d0c310865f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f16634-d0b3-4964-89e5-71f4d7cdeafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Volume volume-cbe454ca-993a-4108-866f-76d0c310865f (cbe454ca-993a-4108-866f-76d0c310865f): created successfully Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f16634-d0b3-4964-89e5-71f4d7cdeafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (7c13680e-1259-4532-8c34-988dc14d9b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4da7518b-0084-47d1-893f-01be8bfaa73a tempest-VolumeDependencyTests-964110210 None] Created volume successfully. Apr 28 15:26:45 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 1073741824" returned: 0 in 0.883s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:45 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 Apr 28 15:26:45 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:46 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46" returned: 0 in 0.754s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.296s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841257208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c338a25-387e-4bda-b1a2-53818fe24cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:39Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Creating volume 6c338a25-387e-4bda-b1a2-53818fe24cb5 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:46 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62df1777-66c4-46ed-b5a0-ab32e17859ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b83fabd-2b48-4811-a260-c10480973a46', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ef4d8-3b0b-4e50-9700-c5b9a4e66e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:46 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 1073741824 Apr 28 15:26:46 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:46 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Volume volume-5b83fabd-2b48-4811-a260-c10480973a46 (5b83fabd-2b48-4811-a260-c10480973a46): created successfully Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ef4d8-3b0b-4e50-9700-c5b9a4e66e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (bc055f77-a5fa-47bf-9d61-26190c8e7334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-834b33d5-a170-406d-ba32-3187a8ef7f36 tempest-CreateVolumesFromImageTest-2100815432 None] Created volume successfully. Apr 28 15:26:47 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 1073741824" returned: 0 in 0.893s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:47 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 Apr 28 15:26:47 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:47 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.509s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471203417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b52fa4-e037-4b45-a571-3e7849876e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d05091c6df49469881f31be749b918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:39Z,use_quota=True,user_id='4da26cf59d464c839758d6acb2f91bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Creating volume 46b52fa4-e037-4b45-a571-3e7849876e6c {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:26:47 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41dd72c-87ce-4636-bdf5-b5e59a437c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c338a25-387e-4bda-b1a2-53818fe24cb5', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943ecc98-29f9-4673-bc52-4fd4bcce5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:47 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c 1073741824 Apr 28 15:26:47 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:47 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Volume volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 (6c338a25-387e-4bda-b1a2-53818fe24cb5): created successfully Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943ecc98-29f9-4673-bc52-4fd4bcce5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (2fcd64f9-1675-44f1-bcbe-cd375637960c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7dbc6eb7-9339-4363-8eac-ee1e6d1f94c0 tempest-CreateVolumesFromImageTest-2100815432 None] Created volume successfully. Apr 28 15:26:48 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c 1073741824" returned: 0 in 0.886s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:48 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c Apr 28 15:26:48 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:49 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c" returned: 0 in 0.631s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.584s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78f50b6-9401-49ba-9e2a-4eed17e1056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b52fa4-e037-4b45-a571-3e7849876e6c', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238f5d64-db97-4386-a5f9-6ee2466a3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating offline snapshot 03e7e568-130a-4512-b735-e32b89db8700 of volume dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:26:49 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Volume volume-46b52fa4-e037-4b45-a571-3e7849876e6c (46b52fa4-e037-4b45-a571-3e7849876e6c): created successfully Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238f5d64-db97-4386-a5f9-6ee2466a3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Flow 'volume_create_manager' (f0edba46-5efa-47b8-bc74-360c13148777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e400d37-b04c-461e-8552-443da5cac9e0]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:49 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-82118e55-39ca-45f5-9f00-cdef6d9b9952 tempest-CreateVolumesFromImageTest-2100815432 None] Created volume successfully. Apr 28 15:26:49 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 Apr 28 15:26:49 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:50 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" returned: 0 in 0.781s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:50 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 1G Apr 28 15:26:50 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-46b52fa4-e037-4b45-a571-3e7849876e6c-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-46b52fa4-e037-4b45-a571-3e7849876e6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:50 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:50 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-quobyte-46b52fa4-e037-4b45-a571-3e7849876e6c" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-46b52fa4-e037-4b45-a571-3e7849876e6c" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb150fbe-5e72-4236-ae7e-621feb2de1d4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:50 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c Apr 28 15:26:50 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:51 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.825s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:51 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 1G" returned: 0 in 1.024s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:51 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 Apr 28 15:26:51 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:51 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c" returned: 0 in 0.975s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:51 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c Apr 28 15:26:51 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:52 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700" returned: 0 in 0.707s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:52 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 is being set with open permissions: ugo+rw Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:52 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 Apr 28 15:26:52 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:52 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-46b52fa4-e037-4b45-a571-3e7849876e6c" returned: 0 in 0.674s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-46b52fa4-e037-4b45-a571-3e7849876e6c" released by "delete_volume" :: held 1.699s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Created reservations ['9731f160-308a-4c3c-9108-0fda8e2e2aa4', '55e33bee-de4f-4233-8a5a-031bfb2a918a', 'd0b1b2ea-ba6f-4582-a056-af72db4fc35d', '8294f04c-af01-4b33-a31e-6d2c1819e24c'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:52 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:52 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-6c338a25-387e-4bda-b1a2-53818fe24cb5-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-6c338a25-387e-4bda-b1a2-53818fe24cb5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:52 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700" returned: 0 in 0.878s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-quobyte-6c338a25-387e-4bda-b1a2-53818fe24cb5" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-6c338a25-387e-4bda-b1a2-53818fe24cb5" acquired by "delete_volume" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2ecc8-eb97-46bb-bca7-472cdb157b90]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:53 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info Apr 28 15:26:53 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:53 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 Apr 28 15:26:53 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:53 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.949s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:53 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Deleted volume successfully. Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b71a191a-2e1d-4910-b004-b50e59af16e9 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-46b52fa4-e037-4b45-a571-3e7849876e6c-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:53 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:53 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info is being set with open permissions: ugo+rw Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:53 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info Apr 28 15:26:53 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:53 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5" returned: 0 in 0.921s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:54 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5 Apr 28 15:26:54 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:54 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.info" returned: 0 in 0.670s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.934s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.453s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Creating offline snapshot dd3362ef-839b-47a8-8acd-ef463f4fa7e8 of volume cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:26:54 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-27f8e1c7-ef85-4bd1-b5f3-30b6d9c77ca5 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Create snapshot completed successfully Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc64f7-0623-4ec8-ae16-841f9b8b832d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:54 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:26:54 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:54 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6c338a25-387e-4bda-b1a2-53818fe24cb5" returned: 0 in 0.791s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-6c338a25-387e-4bda-b1a2-53818fe24cb5" released by "delete_volume" :: held 1.785s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Created reservations ['b9c5b23b-b704-458a-b348-f4f20da739ac', '1d43b04b-0a07-403a-8ef6-d83b83deb358', '2469e2e8-de6c-46f5-b8e1-1eeeb1803a97', 'fe2f192a-43b2-4a1d-8994-ac244fc4acfa'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:55 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:55 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-5b83fabd-2b48-4811-a260-c10480973a46-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-5b83fabd-2b48-4811-a260-c10480973a46-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (01a7f277-e020-48e0-8dc4-ff78b36c22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cced91-4311-4909-a1ad-c3e95b8d266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cced91-4311-4909-a1ad-c3e95b8d266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004317035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8453ff8b-fa84-4d22-bb7f-a236d07ff352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:55Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375a2184-6692-49d3-9423-85fb0f019fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375a2184-6692-49d3-9423-85fb0f019fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a2617-f712-437e-b1a8-10a1ca091f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a2617-f712-437e-b1a8-10a1ca091f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8453ff8b-fa84-4d22-bb7f-a236d07ff352', 'volume_name': 'volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b6542-87c3-4da8-91a7-b558eb8567a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b6542-87c3-4da8-91a7-b558eb8567a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb192d12-8eaf-4612-8a5e-1cef6c6af3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:55 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume 8453ff8b-fa84-4d22-bb7f-a236d07ff352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352', 'volume_size': 1} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-quobyte-5b83fabd-2b48-4811-a260-c10480973a46" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-5b83fabd-2b48-4811-a260-c10480973a46" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[43277d6a-aefa-46a7-bb3d-4056c6f7aa25]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:55 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 1.271s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:55 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 1G Apr 28 15:26:55 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:55 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.872s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:55 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Deleted volume successfully. Apr 28 15:26:55 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 Apr 28 15:26:55 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (9a785602-0056-453b-ac3f-3d2ae2b76fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:55 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830d9d49-be77-4f18-91d2-2c945644d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830d9d49-be77-4f18-91d2-2c945644d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381491709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc11399d-dabc-4ba4-9aa7-d52b9f173748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:56Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5b734b-1265-49e7-be12-7d836c322c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5b734b-1265-49e7-be12-7d836c322c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4923ff8e-0222-460a-9100-7bb081f2d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4923ff8e-0222-460a-9100-7bb081f2d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc11399d-dabc-4ba4-9aa7-d52b9f173748', 'volume_name': 'volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e0bdc9-1b2e-420d-821d-f1576ce9c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e0bdc9-1b2e-420d-821d-f1576ce9c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29775d0-dc43-4599-b91f-8854f2d04242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume fc11399d-dabc-4ba4-9aa7-d52b9f173748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748', 'volume_size': 1} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a15ef887-526a-4b05-b833-f6cf5264d6ad tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-6c338a25-387e-4bda-b1a2-53818fe24cb5-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (63eda87c-8a9b-4ef0-80bb-03bc8fb614df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8173f70-ecff-46b0-9b42-781410ec57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8173f70-ecff-46b0-9b42-781410ec57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002746034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4054de57-6898-44cc-8089-f16b7ce1683e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:56Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52433f43-096b-474c-af6f-7adca0d85501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52433f43-096b-474c-af6f-7adca0d85501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bec310a-80fc-40f6-bfc8-07338776ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bec310a-80fc-40f6-bfc8-07338776ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4054de57-6898-44cc-8089-f16b7ce1683e', 'volume_name': 'volume-4054de57-6898-44cc-8089-f16b7ce1683e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f9455c-4f21-4aca-962f-3712fe18472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f9455c-4f21-4aca-962f-3712fe18472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a721fd4d-4328-404c-9a05-a7ca514912b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume 4054de57-6898-44cc-8089-f16b7ce1683e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4054de57-6898-44cc-8089-f16b7ce1683e', 'volume_size': 1} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (5faeba97-5c22-48b6-8c8f-1e61f399b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ac6ee-b26a-4d9e-9783-dea940d2c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ac6ee-b26a-4d9e-9783-dea940d2c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1338528376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfe1829-8da3-4f31-a860-72744910e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:57Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704ed880-8a6c-4f45-b969-9e38e7e342d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704ed880-8a6c-4f45-b969-9e38e7e342d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960ed90a-f9ad-471f-bbd4-0fe1b9672c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960ed90a-f9ad-471f-bbd4-0fe1b9672c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfe1829-8da3-4f31-a860-72744910e290', 'volume_name': 'volume-1dfe1829-8da3-4f31-a860-72744910e290', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71698f08-b561-47f6-a94d-624fd8d6bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71698f08-b561-47f6-a94d-624fd8d6bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426eea0d-56df-4769-b777-6003156f38d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:56 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume 1dfe1829-8da3-4f31-a860-72744910e290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfe1829-8da3-4f31-a860-72744910e290', 'volume_size': 1} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46" returned: 0 in 1.236s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:56 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:56 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46 Apr 28 15:26:56 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:57 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 1G" returned: 0 in 1.301s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe454ca-993a-4108-866f-76d0c310865f -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:57 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe454ca-993a-4108-866f-76d0c310865f -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:26:57 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (7c9c49cc-758d-4cec-8b91-4bcb64a402ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf3b809-7ea6-4403-917a-22358f57a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf3b809-7ea6-4403-917a-22358f57a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195228842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b90368b-ed13-4e12-a4ac-1204ff6684ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:57Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46847c0-dd73-482b-8b28-213d005e66d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46847c0-dd73-482b-8b28-213d005e66d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72457e99-2513-49ca-9fe1-12f376301998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72457e99-2513-49ca-9fe1-12f376301998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b90368b-ed13-4e12-a4ac-1204ff6684ea', 'volume_name': 'volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b1047-fdc6-4245-b19a-2c494d5647e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b1047-fdc6-4245-b19a-2c494d5647e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737619f4-6ccb-4348-b31f-51d5de4ab031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:26:57 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume 6b90368b-ed13-4e12-a4ac-1204ff6684ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea', 'volume_size': 1} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:57 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-5b83fabd-2b48-4811-a260-c10480973a46" returned: 0 in 0.892s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-5b83fabd-2b48-4811-a260-c10480973a46" released by "delete_volume" :: held 2.224s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Created reservations ['4c5ed6ce-dae1-4e1c-8762-cc96e0a2235d', '7f8b6ec4-9f8f-4729-882a-015f8f55e43f', 'e1d3490c-96e8-41bc-9c8f-cda3ba5f72d0', 'eaddbcd3-aca5-483f-9f77-deb5ae32d856'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:26:57 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe454ca-993a-4108-866f-76d0c310865f -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.814s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:57 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 is being set with open permissions: ugo+rw Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:26:57 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:26:57 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:26:57 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:57 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:26:57 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:58 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-fe1e0b49-620a-49c0-8ec3-792e68072471-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:58 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.739s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-fe1e0b49-620a-49c0-8ec3-792e68072471-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:58 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Deleted volume successfully. Apr 28 15:26:58 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info Apr 28 15:26:58 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7f91e586-b1d0-4d59-be90-8d67813f468f tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-5b83fabd-2b48-4811-a260-c10480973a46-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-quobyte-fe1e0b49-620a-49c0-8ec3-792e68072471" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-fe1e0b49-620a-49c0-8ec3-792e68072471" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a145a70-ac8c-435b-96ef-83b460b7ae2a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:26:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:58 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 Apr 28 15:26:58 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:59 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info" returned: 0 in 0.775s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:59 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info is being set with open permissions: ugo+rw Apr 28 15:26:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:59 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info Apr 28 15:26:59 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:26:59 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 28 15:26:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471" returned: 0 in 0.823s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:26:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:26:59 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471 Apr 28 15:26:59 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:00 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.info" returned: 0 in 0.822s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.822s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.737s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004317035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8453ff8b-fa84-4d22-bb7f-a236d07ff352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:55Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume 8453ff8b-fa84-4d22-bb7f-a236d07ff352 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:00 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:00 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 1073741824 Apr 28 15:27:00 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:00 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ff48e4ab-d190-4d8a-98a0-23e62e5ef3ac tempest-VolumeDependencyTests-964110210 None] Create snapshot completed successfully Apr 28 15:27:00 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fe1e0b49-620a-49c0-8ec3-792e68072471" returned: 0 in 0.768s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-fe1e0b49-620a-49c0-8ec3-792e68072471" released by "delete_volume" :: held 1.647s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Created reservations ['b721e9bc-7c93-453f-acc7-c3f19ff1078f', '89614f6d-289d-46bd-98a4-f1449b1bf8d8', '836511a8-a841-48c7-a06c-1888a934b09c', '65ba4299-4609-4e4f-97fe-6c937af3545e'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:00 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:00 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-4e4284be-1038-447d-a9f3-dbc048ab3efd-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:01 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.788s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:01 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (ee2aa192-64fb-4249-88ab-b604341ea209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c342afe0-f1d6-4170-8890-3f94beff63ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-4e4284be-1038-447d-a9f3-dbc048ab3efd-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:01 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Deleted volume successfully. Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 1073741824" returned: 0 in 1.136s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c342afe0-f1d6-4170-8890-3f94beff63ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2001748031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd3362ef-839b-47a8-8acd-ef463f4fa7e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:01Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70749b44-5b08-4a8b-b035-ee6c4f6ddb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70749b44-5b08-4a8b-b035-ee6c4f6ddb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b52eeec-a5ff-44c6-855d-9d228646c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b52eeec-a5ff-44c6-855d-9d228646c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55', 'volume_name': 'volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55', 'volume_size': 1, 'snapshot_id': 'dd3362ef-839b-47a8-8acd-ef463f4fa7e8'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f11924-2ad1-46f6-9c1e-5f6a830e2a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f11924-2ad1-46f6-9c1e-5f6a830e2a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f672617-ee89-4428-a02d-61cc0b21ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Volume 39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55', 'volume_size': 1, 'snapshot_id': 'dd3362ef-839b-47a8-8acd-ef463f4fa7e8'} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-a9b34000-71d1-4b0b-8826-843fc9567369 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-fe1e0b49-620a-49c0-8ec3-792e68072471-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "cinder-quobyte-4e4284be-1038-447d-a9f3-dbc048ab3efd" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-4e4284be-1038-447d-a9f3-dbc048ab3efd" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:01 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 Apr 28 15:27:01 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e049c-934d-474b-8589-88068fc6fba4]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Flow 'volume_create_manager' (e83e98c8-76b5-4bd3-a11d-62d65ae5b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754982db-3f97-4422-910a-9dd22ea1b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754982db-3f97-4422-910a-9dd22ea1b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2089802574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f67f68c-939e-4600-8ae4-e89f622aec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5468f835b74c1f947f272239846c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:02Z,use_quota=True,user_id='e9d45aea9f9c45edae2223d39175acb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a69d32b-5bb5-46d5-b5ef-69f3ca48a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a69d32b-5bb5-46d5-b5ef-69f3ca48a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a32c5e7-e4be-4501-8824-46777b0691f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a32c5e7-e4be-4501-8824-46777b0691f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f67f68c-939e-4600-8ae4-e89f622aec55', 'volume_name': 'volume-7f67f68c-939e-4600-8ae4-e89f622aec55', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3399cd03-f151-4d8e-9515-96b09470c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3399cd03-f151-4d8e-9515-96b09470c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8428979b-1979-464b-bf6c-7e052a0d02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:01 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Volume 7f67f68c-939e-4600-8ae4-e89f622aec55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f67f68c-939e-4600-8ae4-e89f622aec55', 'volume_size': 1} Apr 28 15:27:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:01 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd Apr 28 15:27:01 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:02 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352" returned: 0 in 0.637s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.052s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381491709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc11399d-dabc-4ba4-9aa7-d52b9f173748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:56Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume fc11399d-dabc-4ba4-9aa7-d52b9f173748 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:02 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb192d12-8eaf-4612-8a5e-1cef6c6af3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:02 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 1073741824 Apr 28 15:27:02 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6844e756-e5e9-41f7-b42d-948eb7f5c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:02 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 (8453ff8b-fa84-4d22-bb7f-a236d07ff352): created successfully Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6844e756-e5e9-41f7-b42d-948eb7f5c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (01a7f277-e020-48e0-8dc4-ff78b36c22ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:02 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cde2b04a-2e00-47d9-9a0b-126b5641576b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:27:02 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd" returned: 0 in 0.771s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:02 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd Apr 28 15:27:02 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:02 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4e4284be-1038-447d-a9f3-dbc048ab3efd" returned: 0 in 0.648s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:02 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 1073741824" returned: 0 in 0.843s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-quobyte-4e4284be-1038-447d-a9f3-dbc048ab3efd" released by "delete_volume" :: held 1.482s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:03 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 Apr 28 15:27:03 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Created reservations ['30b7cd21-ac08-4a70-8557-0bd35c631300', '6d8027e1-c86c-4568-9769-210efdf9372c', '4b7c673b-20dc-4d2b-b0b0-88943e96ba9e', '36d531dc-0e91-4353-9530-19b9efad1d8c'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:03 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:03 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:03 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748" returned: 0 in 0.672s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.433s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002746034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4054de57-6898-44cc-8089-f16b7ce1683e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:56Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume 4054de57-6898-44cc-8089-f16b7ce1683e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:03 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:03 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e 1073741824 Apr 28 15:27:03 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:03 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29775d0-dc43-4599-b91f-8854f2d04242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be8d8a1-cc4f-40a4-bb4a-916a111df510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.655s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Deleted volume successfully. Apr 28 15:27:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 (fc11399d-dabc-4ba4-9aa7-d52b9f173748): created successfully Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be8d8a1-cc4f-40a4-bb4a-916a111df510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (9a785602-0056-453b-ac3f-3d2ae2b76fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3651524c-90d7-4612-95c1-4c3c871dd573 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:27:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-0b3dd7f5-cb85-4e0c-8f85-81d1733ab7d3 tempest-CreateVolumesFromImageTest-2100815432 None] Lock "cinder-4e4284be-1038-447d-a9f3-dbc048ab3efd-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:04 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e 1073741824" returned: 0 in 0.885s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:04 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e Apr 28 15:27:04 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:05 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e" returned: 0 in 0.683s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.517s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1338528376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfe1829-8da3-4f31-a860-72744910e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:57Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume 1dfe1829-8da3-4f31-a860-72744910e290 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:05 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a721fd4d-4328-404c-9a05-a7ca514912b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4054de57-6898-44cc-8089-f16b7ce1683e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:05 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 1073741824 Apr 28 15:27:05 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c1c72-8620-4d8a-98ec-d4641d7a0a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:05 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-4054de57-6898-44cc-8089-f16b7ce1683e (4054de57-6898-44cc-8089-f16b7ce1683e): created successfully Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c1c72-8620-4d8a-98ec-d4641d7a0a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:05 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (63eda87c-8a9b-4ef0-80bb-03bc8fb614df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:05 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-cc40c13d-fa2a-4461-a8d6-0dfcfe553ece tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:27:06 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 1073741824" returned: 0 in 0.977s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:06 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 Apr 28 15:27:06 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (5981d66b-fdad-49c0-be01-5f48530b4309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d70f5-280f-4999-aace-09a3c99080f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d70f5-280f-4999-aace-09a3c99080f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175142664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6b8078-d313-4bc8-9191-8e93dd9c547d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:07Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d753a9-a447-46ff-bf92-b7ccc8cf67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d753a9-a447-46ff-bf92-b7ccc8cf67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289a9e7-5332-41a4-882e-ec867c9f81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289a9e7-5332-41a4-882e-ec867c9f81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6b8078-d313-4bc8-9191-8e93dd9c547d', 'volume_name': 'volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03879ba3-8f72-4bc5-84b0-c468bddb9eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03879ba3-8f72-4bc5-84b0-c468bddb9eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ef0d89-7d97-45fb-a879-682dc284029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:06 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume 4d6b8078-d313-4bc8-9191-8e93dd9c547d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d', 'volume_size': 1} Apr 28 15:27:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:07 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290" returned: 0 in 0.677s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.637s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195228842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b90368b-ed13-4e12-a4ac-1204ff6684ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7362a7ef8747a0a633eeec2a5d349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:26:57Z,use_quota=True,user_id='02b34e1f9aa64a37a27fe9a320706a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Creating volume 6b90368b-ed13-4e12-a4ac-1204ff6684ea {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:07 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426eea0d-56df-4769-b777-6003156f38d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfe1829-8da3-4f31-a860-72744910e290', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:07 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea 1073741824 Apr 28 15:27:07 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89b75ea-ec51-474c-aebb-7d15edb4a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:07 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-1dfe1829-8da3-4f31-a860-72744910e290 (1dfe1829-8da3-4f31-a860-72744910e290): created successfully Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89b75ea-ec51-474c-aebb-7d15edb4a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (5faeba97-5c22-48b6-8c8f-1e61f399b564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:07 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-73acbaf6-0e8b-4f66-beb7-be9a226ed5f6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:27:07 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea 1073741824" returned: 0 in 0.767s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:07 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea Apr 28 15:27:07 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:08 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea" returned: 0 in 0.588s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.996s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737619f4-6ccb-4348-b31f-51d5de4ab031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf1a138-52e2-4c7f-87df-e21020aa3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Creating volume 39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 from snapshot dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:08 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Volume volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea (6b90368b-ed13-4e12-a4ac-1204ff6684ea): created successfully Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf1a138-52e2-4c7f-87df-e21020aa3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Flow 'volume_create_manager' (7c9c49cc-758d-4cec-8b91-4bcb64a402ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] snapshot: dd3362ef-839b-47a8-8acd-ef463f4fa7e8, volume: 39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:27:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ac27ebf4-a4da-4b0e-8f91-5ac3fe56e0bf tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created volume successfully. Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f44247-57ba-48c6-b4b8-1deda7eece2e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:08 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:27:08 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:09 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.743s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbe454ca-993a-4108-866f-76d0c310865f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299151b-f2e4-46e6-8200-e57d160ae2d9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-6b90368b-ed13-4e12-a4ac-1204ff6684ea-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-6b90368b-ed13-4e12-a4ac-1204ff6684ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:09 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:27:09 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-6b90368b-ed13-4e12-a4ac-1204ff6684ea" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-6b90368b-ed13-4e12-a4ac-1204ff6684ea" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d0837-bbd4-490b-aad7-99c77505a006]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:09 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea Apr 28 15:27:09 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:10 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 0.775s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:10 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 Apr 28 15:27:10 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:10 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea" returned: 0 in 0.735s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:10 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea Apr 28 15:27:10 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:10 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-6b90368b-ed13-4e12-a4ac-1204ff6684ea" returned: 0 in 0.631s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-6b90368b-ed13-4e12-a4ac-1204ff6684ea" released by "delete_volume" :: held 1.408s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:10 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['8dacab1d-b421-4fa0-876f-d413ccf83f57', '6bb5b9af-3df9-4500-9e0e-7430f55f08f0', '31fe6ce6-a5c4-4093-a935-45bc25bc8450', 'b8163d7e-8e28-4104-8e73-00a8f322d2f4'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:11 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:11 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-1dfe1829-8da3-4f31-a860-72744910e290-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-1dfe1829-8da3-4f31-a860-72744910e290-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-1dfe1829-8da3-4f31-a860-72744910e290" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-1dfe1829-8da3-4f31-a860-72744910e290" acquired by "delete_volume" :: waited 0.060s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5786f-64fa-431c-88b5-e3a999229518]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:12 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.038s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:12 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:12 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:12 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3f3c730b-40a9-4a9f-8566-43198d3cfd2e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-6b90368b-ed13-4e12-a4ac-1204ff6684ea-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:12 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 Apr 28 15:27:12 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:13 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290" returned: 0 in 1.284s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:13 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290 Apr 28 15:27:13 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:14 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1dfe1829-8da3-4f31-a860-72744910e290" returned: 0 in 1.420s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-1dfe1829-8da3-4f31-a860-72744910e290" released by "delete_volume" :: held 2.832s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:14 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['b6b9c7d3-2c80-4968-95c4-e70388751fd7', '45a9bceb-714b-4332-8a10-fa7af6b5d727', '6b536b30-aa9e-408a-b534-22b61ea169d2', '03c10b40-58ea-403d-a7bd-80e011803166'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:15 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:15 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-4054de57-6898-44cc-8089-f16b7ce1683e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-4054de57-6898-44cc-8089-f16b7ce1683e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-4054de57-6898-44cc-8089-f16b7ce1683e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-4054de57-6898-44cc-8089-f16b7ce1683e" acquired by "delete_volume" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9fe85-ec9f-41b3-91db-368afca05cd1]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:15 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" returned: 0 in 5.776s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbcc4aa-d6b0-435f-a23a-1e2a15237998]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:15 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e Apr 28 15:27:15 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:16 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:27:16 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:16 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.039s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-574f5591-1d4b-4be0-bf8d-7e21788d4ffc tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-1dfe1829-8da3-4f31-a860-72744910e290-delete_volume" released by "delete_volume" :: held 4.419s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:16 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e" returned: 0 in 0.762s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:16 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e Apr 28 15:27:16 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:16 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 0.943s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:27:16 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Converted 1024.00 MB image at 177.25 MB/s Apr 28 15:27:16 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 is being set with open permissions: ugo+rw Apr 28 15:27:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:16 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 Apr 28 15:27:16 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:17 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4054de57-6898-44cc-8089-f16b7ce1683e" returned: 0 in 0.640s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-4054de57-6898-44cc-8089-f16b7ce1683e" released by "delete_volume" :: held 1.474s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['713d4478-67ef-430a-b0e9-f81adb9dd485', '1ecfb356-4b31-4af3-9317-c574f6086f1a', 'e3b6073b-a0dd-41ae-bca0-44f11a9f4003', '93a6e6af-ddf7-4e62-a7cf-acfa7e5ea452'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:17 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:17 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:17 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" returned: 0 in 0.587s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" released by "_copy_volume_from_snapshot" :: held 8.940s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" released by "_create_volume_from_snapshot" :: held 8.982s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.803s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2089802574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f67f68c-939e-4600-8ae4-e89f622aec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5468f835b74c1f947f272239846c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:02Z,use_quota=True,user_id='e9d45aea9f9c45edae2223d39175acb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Creating volume 7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:17 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:17 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 1073741824 Apr 28 15:27:17 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f672617-ee89-4428-a02d-61cc0b21ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55', 'volume_size': 1, 'snapshot_id': 'dd3362ef-839b-47a8-8acd-ef463f4fa7e8'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0057c09b-283b-4644-8638-5c74bb077cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:17 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Volume volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 (39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55): created successfully Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0057c09b-283b-4644-8638-5c74bb077cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (ee2aa192-64fb-4249-88ab-b604341ea209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3ad1d00f-8717-4ba1-97b3-5c0f79e80e71 tempest-VolumeDependencyTests-964110210 None] Created volume successfully. Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-fc11399d-dabc-4ba4-9aa7-d52b9f173748-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-fc11399d-dabc-4ba4-9aa7-d52b9f173748-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:17 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.622s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:17 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:17 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-96d0bbd4-810d-4a8f-b0d5-c1d1ab7c491a tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-4054de57-6898-44cc-8089-f16b7ce1683e-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-fc11399d-dabc-4ba4-9aa7-d52b9f173748" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-fc11399d-dabc-4ba4-9aa7-d52b9f173748" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[d429496b-d171-4973-8064-970e0c99b7d9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:18 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 Apr 28 15:27:18 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:18 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 1073741824" returned: 0 in 0.815s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:18 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:18 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Deleting offline snapshot dd3362ef-839b-47a8-8acd-ef463f4fa7e8 of volume cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] snapshot_file for this snap is: volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f599a970-f35e-4bd8-b3a7-152d7c898b97]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:18 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748" returned: 0 in 0.771s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:18 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:27:18 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:18 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748 Apr 28 15:27:18 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:19 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.717s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.333s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175142664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6b8078-d313-4bc8-9191-8e93dd9c547d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:07Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume 4d6b8078-d313-4bc8-9191-8e93dd9c547d {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:19 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8428979b-1979-464b-bf6c-7e052a0d02d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f67f68c-939e-4600-8ae4-e89f622aec55', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:19 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d 1073741824 Apr 28 15:27:19 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564a5e5e-6f54-4ba4-abf5-e586d13ed085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:19 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Volume volume-7f67f68c-939e-4600-8ae4-e89f622aec55 (7f67f68c-939e-4600-8ae4-e89f622aec55): created successfully Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564a5e5e-6f54-4ba4-abf5-e586d13ed085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Flow 'volume_create_manager' (e83e98c8-76b5-4bd3-a11d-62d65ae5b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:19 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-599c2725-c873-4187-b9f2-15325baeb753 tempest-SnapshotDependencyTests-1753890626 None] Created volume successfully. Apr 28 15:27:19 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.802s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbe454ca-993a-4108-866f-76d0c310865f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:19 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-fc11399d-dabc-4ba4-9aa7-d52b9f173748" returned: 0 in 0.713s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da8d49-73a0-40e5-8ba2-d103323001f0]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-fc11399d-dabc-4ba4-9aa7-d52b9f173748" released by "delete_volume" :: held 1.538s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['f34c0bdc-ff58-404c-acf4-9851b1a69406', 'c77f4870-a221-4398-b89d-bbb86d9a8a29', 'b66628f2-c4a3-407b-a739-ea5540f5e552', 'ba602f40-e8ee-4aec-bdd8-2bde708325c9'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:19 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:27:19 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:19 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:19 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:19 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:19 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d 1073741824" returned: 0 in 0.902s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:20 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d Apr 28 15:27:20 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-8453ff8b-fa84-4d22-bb7f-a236d07ff352-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-8453ff8b-fa84-4d22-bb7f-a236d07ff352-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-8453ff8b-fa84-4d22-bb7f-a236d07ff352" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:20 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-8453ff8b-fa84-4d22-bb7f-a236d07ff352" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.717s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baca4f7-e247-4e8c-9e93-2102e4467b9c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-406222a7-22f6-4a23-b6d2-c5db26611b02 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-fc11399d-dabc-4ba4-9aa7-d52b9f173748-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:20 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 0.990s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:20 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:27:20 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:20 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 Apr 28 15:27:20 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:20 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d" returned: 0 in 0.758s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.184s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ef0d89-7d97-45fb-a879-682dc284029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22610a7-29ad-416c-9d0c-a70d2492736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Creating offline snapshot b118fb5d-8b66-450f-a235-e1e9a28ce033 of volume 7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:27:20 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d (4d6b8078-d313-4bc8-9191-8e93dd9c547d): created successfully Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22610a7-29ad-416c-9d0c-a70d2492736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (5981d66b-fdad-49c0-be01-5f48530b4309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd0884-f3b4-48fb-89b1-93179141ea30]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:20 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:20 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fc9cfdee-57f3-4a61-ae48-95f0fcee1eea tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:20 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:20 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:21 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.834s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:21 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8 Apr 28 15:27:21 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (ca5b46bb-1cc3-47d9-98b6-a62ea40bbb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da7f81f-1383-41f0-b423-9ce5695bfb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:21 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352" returned: 0 in 1.069s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da7f81f-1383-41f0-b423-9ce5695bfb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739243109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f73179-7728-466b-a57a-d658777be996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:21Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf1ca99-0ea7-4b78-bead-d25ef31d3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:21 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352 Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf1ca99-0ea7-4b78-bead-d25ef31d3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:21 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6d2d45-64cf-4b14-a900-6e0fb604dc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6d2d45-64cf-4b14-a900-6e0fb604dc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f73179-7728-466b-a57a-d658777be996', 'volume_name': 'volume-06f73179-7728-466b-a57a-d658777be996', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b730e5a-0c4a-4c52-b765-a9420b225a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b730e5a-0c4a-4c52-b765-a9420b225a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03ec421-b8ff-472d-94a5-abc007d36dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:21 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume 06f73179-7728-466b-a57a-d658777be996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f73179-7728-466b-a57a-d658777be996', 'volume_size': 1} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:21 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.910s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:21 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 1G Apr 28 15:27:21 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:21 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (f6e55c10-c1f3-433b-9436-35f90aeeb1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0fb23a-a9c3-45e8-a49f-21aea54cad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0fb23a-a9c3-45e8-a49f-21aea54cad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1661503318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ea98a-826f-4653-9d10-fc96b7afbdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:22Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6447f59-5f07-4623-a303-e519e9ef624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6447f59-5f07-4623-a303-e519e9ef624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb360b3-777d-4051-89cb-00f290bd705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb360b3-777d-4051-89cb-00f290bd705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36ea98a-826f-4653-9d10-fc96b7afbdc7', 'volume_name': 'volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfb53cd-812a-4c34-9aea-def9c1bf7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfb53cd-812a-4c34-9aea-def9c1bf7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fe2063-643a-42af-b5ec-7340f2fca14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume e36ea98a-826f-4653-9d10-fc96b7afbdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7', 'volume_size': 1} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:22 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f.dd3362ef-839b-47a8-8acd-ef463f4fa7e8" returned: 0 in 0.845s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-dd3362ef-839b-47a8-8acd-ef463f4fa7e8" released by "_delete_snapshot" :: held 3.611s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" released by "delete_snapshot" :: held 3.647s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:22 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-8453ff8b-fa84-4d22-bb7f-a236d07ff352" returned: 0 in 0.805s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-8453ff8b-fa84-4d22-bb7f-a236d07ff352" released by "delete_volume" :: held 1.941s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Created reservations ['4d75d7bd-f45e-43b7-8d19-db350a8334f3', '2c47577f-5585-4a05-8386-b52ad49a51fe', '8238691f-ba74-40ab-9132-46e40abdd86c', '60150b1a-4412-45c2-b648-9ff3fd7a66a1'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['ac0989a9-f614-44c9-bfb2-f7c60695e10c', 'e0c3d7e8-5ce2-4883-942b-93f865906221', '4fb6e738-d75d-43d2-8489-e4c78b78b06f', '3d342953-3833-4414-b818-1ffded82aeb4'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (89eec62f-20dd-4046-8b7c-45e9619caed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a51d2-35ea-41ef-880b-682a768ecea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a51d2-35ea-41ef-880b-682a768ecea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1954398158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b4a2b-f351-4166-afd1-4788dff5432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:22Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0783b991-e523-4938-932e-4af56ed8cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0783b991-e523-4938-932e-4af56ed8cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c248f22e-c170-4f0b-aa24-5de77a8524c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c248f22e-c170-4f0b-aa24-5de77a8524c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230b4a2b-f351-4166-afd1-4788dff5432e', 'volume_name': 'volume-230b4a2b-f351-4166-afd1-4788dff5432e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61727b3-cb34-4948-968f-659681438703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61727b3-cb34-4948-968f-659681438703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7be41c-c4be-4e13-bc8a-55b3c6a2a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:22 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume 230b4a2b-f351-4166-afd1-4788dff5432e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230b4a2b-f351-4166-afd1-4788dff5432e', 'volume_size': 1} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:22 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Delete snapshot completed successfully. Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-03e7e568-130a-4512-b735-e32b89db8700-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-c918a9f0-5265-42fc-8e59-02c665230335 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-dd3362ef-839b-47a8-8acd-ef463f4fa7e8-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-03e7e568-130a-4512-b735-e32b89db8700-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" acquired by "delete_snapshot" :: waited 0.091s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-03e7e568-130a-4512-b735-e32b89db8700" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-03e7e568-130a-4512-b735-e32b89db8700" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleting offline snapshot 03e7e568-130a-4512-b735-e32b89db8700 of volume dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:27:22 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] snapshot_file for this snap is: volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677c706-6743-4b18-85b9-448ae6ee536a]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 1G" returned: 0 in 1.117s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f67f68c-939e-4600-8ae4-e89f622aec55 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:22 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:22 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:22 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-cbe454ca-993a-4108-866f-76d0c310865f-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:22 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f67f68c-939e-4600-8ae4-e89f622aec55 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:22 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-cbe454ca-993a-4108-866f-76d0c310865f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" acquired by "delete_volume" :: waited 0.030s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:23 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 Apr 28 15:27:23 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffc8605-e79f-48c5-972b-03c4705c8674]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (6cd96e02-3072-4ff1-bd6e-a06e01986a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc68d61-55f0-4be2-b266-a7009fe6393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc68d61-55f0-4be2-b266-a7009fe6393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001288144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7481b-2793-474e-95f9-a549ce6b825f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:23Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b915946-f237-4766-a8bb-72690b37337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b915946-f237-4766-a8bb-72690b37337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e466f5-5fc6-4059-866e-c0df3736b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e466f5-5fc6-4059-866e-c0df3736b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f7481b-2793-474e-95f9-a549ce6b825f', 'volume_name': 'volume-f5f7481b-2793-474e-95f9-a549ce6b825f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c07e54-86bb-4e86-adf4-8fc03055fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c07e54-86bb-4e86-adf4-8fc03055fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb17890-c403-466e-b131-dcb94f412db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume f5f7481b-2793-474e-95f9-a549ce6b825f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f7481b-2793-474e-95f9-a549ce6b825f', 'volume_size': 1} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:23 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:27:23 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:23 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.945s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (0c7c6ed1-5834-4976-9d9d-bdb6df019621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da7c6b5-e111-4157-9ec6-bdd2f13eb8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da7c6b5-e111-4157-9ec6-bdd2f13eb8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547058856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3efdf64-ba8f-483c-9856-3d90d230318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:24Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a17ea7b-9c30-424c-804b-78ad6e82193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a17ea7b-9c30-424c-804b-78ad6e82193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96800a-555a-4121-b2a3-2fdb52d62859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96800a-555a-4121-b2a3-2fdb52d62859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3efdf64-ba8f-483c-9856-3d90d230318a', 'volume_name': 'volume-d3efdf64-ba8f-483c-9856-3d90d230318a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdb679-c4f6-41e0-bcb3-e3282976317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdb679-c4f6-41e0-bcb3-e3282976317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2154b1e4-2e3d-43b9-be0c-756ac937217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:23 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume d3efdf64-ba8f-483c-9856-3d90d230318a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3efdf64-ba8f-483c-9856-3d90d230318a', 'volume_size': 1} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:23 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-90276a20-f6ac-455a-bea3-ae1d97ec782b tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-8453ff8b-fa84-4d22-bb7f-a236d07ff352-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:24 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f67f68c-939e-4600-8ae4-e89f622aec55 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 1.109s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 is being set with open permissions: ugo+rw Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:24 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:24 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:24 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700" returned: 0 in 1.182s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bedfa-a073-4ba6-95ff-885c9fc2d9f9]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:24 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 Apr 28 15:27:24 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:24 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 1.105s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:24 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f Apr 28 15:27:24 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:24 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 0.628s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:24 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info Apr 28 15:27:24 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:24 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" returned: 0 in 0.765s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:24 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 Apr 28 15:27:24 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:24 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-cbe454ca-993a-4108-866f-76d0c310865f" returned: 0 in 0.636s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-cbe454ca-993a-4108-866f-76d0c310865f" released by "delete_volume" :: held 1.836s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:24 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Created reservations ['69183561-c1b8-46bf-93d4-423a7b94321a', '800296b5-83cc-4b96-847c-0c21eb54c6e2', '3b6da728-8165-40f2-8709-97a9207fbb59', 'df684472-af9c-4c12-9593-e156a3a623a2'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:25 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:25 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:25 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info" returned: 0 in 0.656s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:25 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info is being set with open permissions: ugo+rw Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:25 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info Apr 28 15:27:25 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:25 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700" returned: 0 in 0.825s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:25 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700 Apr 28 15:27:25 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (13f826f5-11c6-4b62-a503-922d251c2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e2eec-d302-49cc-af50-9772fd808c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e2eec-d302-49cc-af50-9772fd808c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1321910642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b719900-10ef-4e90-8b75-13b2695ff8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:26Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87503b7-e396-4dc0-994b-8771cdf4a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87503b7-e396-4dc0-994b-8771cdf4a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bd6769-16e8-47ea-990e-f9b897044c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bd6769-16e8-47ea-990e-f9b897044c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b719900-10ef-4e90-8b75-13b2695ff8c2', 'volume_name': 'volume-3b719900-10ef-4e90-8b75-13b2695ff8c2', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a27d786-404b-424d-8c50-10236b689955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a27d786-404b-424d-8c50-10236b689955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b420ba-12c7-4503-bef3-6d77d701a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:25 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Volume 3b719900-10ef-4e90-8b75-13b2695ff8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b719900-10ef-4e90-8b75-13b2695ff8c2', 'volume_size': 1} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:25 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.810s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:25 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Deleted volume successfully. Apr 28 15:27:25 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-7dce6fbe-3af9-465e-b18b-1d05a3d196e5 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-cbe454ca-993a-4108-866f-76d0c310865f-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:26 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.info" returned: 0 in 0.720s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.293s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.448s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739243109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f73179-7728-466b-a57a-d658777be996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:21Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume 06f73179-7728-466b-a57a-d658777be996 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:26 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:26 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 1073741824 Apr 28 15:27:26 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ac1be8cc-e09e-4f98-81be-6769009b50a5 tempest-SnapshotDependencyTests-1753890626 None] Create snapshot completed successfully Apr 28 15:27:26 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696.03e7e568-130a-4512-b735-e32b89db8700" returned: 0 in 0.698s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-03e7e568-130a-4512-b735-e32b89db8700" released by "_delete_snapshot" :: held 3.625s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" released by "delete_snapshot" :: held 3.662s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['ddedb01a-4c05-4bf6-b825-371d40371355', 'f4b6dca3-bb4b-42ad-b58d-43fa5fa0c14b', '041aeeea-1c59-4779-a895-c965c5cc8b33', '02a670b0-684a-45b9-95aa-5a62bb971425'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:26 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Delete snapshot completed successfully. Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-969eb54a-0d8e-4389-aa4e-ffb372f352e6 tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-03e7e568-130a-4512-b735-e32b89db8700-delete_snapshot" released by "delete_snapshot" :: held 3.874s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:26 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 1073741824" returned: 0 in 0.828s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:26 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:26 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 Apr 28 15:27:26 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0ee74-4095-4881-acdf-3960e15b4a3c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:27 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 Apr 28 15:27:27 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Flow 'volume_create_manager' (8b64bb2d-98ce-4f28-b580-7652f9b3ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39435a20-9cbd-4925-9e1c-0f0100a5e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39435a20-9cbd-4925-9e1c-0f0100a5e710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c110af-c378-40e5-973e-64358ae54a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5468f835b74c1f947f272239846c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b118fb5d-8b66-450f-a235-e1e9a28ce033,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:28Z,use_quota=True,user_id='e9d45aea9f9c45edae2223d39175acb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f2bc9-47e1-43e5-b19d-baf514aa7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f2bc9-47e1-43e5-b19d-baf514aa7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27042de-020a-4486-841e-0e8b8d5cbd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27042de-020a-4486-841e-0e8b8d5cbd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97c110af-c378-40e5-973e-64358ae54a79', 'volume_name': 'volume-97c110af-c378-40e5-973e-64358ae54a79', 'volume_size': 1, 'snapshot_id': 'b118fb5d-8b66-450f-a235-e1e9a28ce033'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a1b90-b02c-46c1-90b2-a8309aab3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a1b90-b02c-46c1-90b2-a8309aab3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e86e7c-edc9-4110-83aa-0f8aa9ab6cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Volume 97c110af-c378-40e5-973e-64358ae54a79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97c110af-c378-40e5-973e-64358ae54a79', 'volume_size': 1, 'snapshot_id': 'b118fb5d-8b66-450f-a235-e1e9a28ce033'} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996" returned: 0 in 0.728s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.522s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1661503318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ea98a-826f-4653-9d10-fc96b7afbdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:22Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume e36ea98a-826f-4653-9d10-fc96b7afbdc7 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:27 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:27 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 1073741824 Apr 28 15:27:27 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03ec421-b8ff-472d-94a5-abc007d36dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f73179-7728-466b-a57a-d658777be996', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d8bd50-4feb-46cb-a4a0-1345132f8efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:27 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-06f73179-7728-466b-a57a-d658777be996 (06f73179-7728-466b-a57a-d658777be996): created successfully Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d8bd50-4feb-46cb-a4a0-1345132f8efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (ca5b46bb-1cc3-47d9-98b6-a62ea40bbb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:27 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-a9aae513-e872-4550-b87e-dffbc2baff67 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:27 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" returned: 0 in 0.780s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:27 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:27 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696 Apr 28 15:27:27 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:28 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 1073741824" returned: 0 in 0.836s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:28 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" returned: 0 in 0.642s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-quobyte-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696" released by "delete_volume" :: held 1.502s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:28 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 Apr 28 15:27:28 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Created reservations ['a8894f7d-faf2-4862-9da5-c32086940491', '73138334-02b6-418e-86a2-6121f84955dd', 'c91085af-3a72-49ce-919c-7242d3e0ac39', 'aa2e7acd-a4a0-46ba-888a-f4fc1a96b917'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:28 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:28 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:28 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:29 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7" returned: 0 in 0.627s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.612s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1954398158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b4a2b-f351-4166-afd1-4788dff5432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:22Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume 230b4a2b-f351-4166-afd1-4788dff5432e {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:29 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fe2063-643a-42af-b5ec-7340f2fca14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:29 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e 1073741824 Apr 28 15:27:29 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4c8a68-3944-451e-9839-c3c69eead8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:29 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 (e36ea98a-826f-4653-9d10-fc96b7afbdc7): created successfully Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4c8a68-3944-451e-9839-c3c69eead8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (f6e55c10-c1f3-433b-9436-35f90aeeb1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-4e41ef4b-6193-4955-a425-89062831299d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:29 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.644s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:29 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Deleted volume successfully. Apr 28 15:27:29 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-ef2eb4a7-5aa2-4703-aee0-973160df661e tempest-CreateVolumesFromSnapshotTest-1067817878 None] Lock "cinder-dfb7bdfe-df27-43ff-9bd9-0ab20f73a696-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:30 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e 1073741824" returned: 0 in 0.901s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:30 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e Apr 28 15:27:30 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:30 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e" returned: 0 in 0.682s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.474s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001288144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7481b-2793-474e-95f9-a549ce6b825f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:23Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume f5f7481b-2793-474e-95f9-a549ce6b825f {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:30 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:30 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f 1073741824 Apr 28 15:27:30 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7be41c-c4be-4e13-bc8a-55b3c6a2a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230b4a2b-f351-4166-afd1-4788dff5432e', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25a67b5-efab-44fb-bfad-451dab1c2437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:30 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-230b4a2b-f351-4166-afd1-4788dff5432e (230b4a2b-f351-4166-afd1-4788dff5432e): created successfully Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25a67b5-efab-44fb-bfad-451dab1c2437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:30 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (89eec62f-20dd-4046-8b7c-45e9619caed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:31 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e0a66bb3-7866-481e-ba32-cbe5249bd2d1 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:31 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f 1073741824" returned: 0 in 0.861s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:31 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:31 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f Apr 28 15:27:31 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Flow 'volume_create_manager' (b6c6c3b2-7f7f-40f5-8831-67a213c83d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee503e3f-05c6-435b-a5d3-ad469b79fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee503e3f-05c6-435b-a5d3-ad469b79fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1103c731-a975-46bb-9240-1b1981aa52dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e4211385114de89026c958be2ef2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:32Z,use_quota=True,user_id='4e612cdca31944d28560a2ac1857a740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1b47ae-8a36-41ed-880d-2727bfd4ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1b47ae-8a36-41ed-880d-2727bfd4ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d921b5b-5cec-4300-99f1-9e35241dbe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d921b5b-5cec-4300-99f1-9e35241dbe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1103c731-a975-46bb-9240-1b1981aa52dd', 'volume_name': 'volume-1103c731-a975-46bb-9240-1b1981aa52dd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3953bc-fc77-47a0-8e4e-71d3fc1ae014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3953bc-fc77-47a0-8e4e-71d3fc1ae014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87963eea-9f63-4511-9a1b-dcd4af058182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Volume 1103c731-a975-46bb-9240-1b1981aa52dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1103c731-a975-46bb-9240-1b1981aa52dd', 'volume_size': 1} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:32 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f" returned: 0 in 0.672s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.548s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547058856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3efdf64-ba8f-483c-9856-3d90d230318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae40b0ece60b4cc09cf277194cab828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:24Z,use_quota=True,user_id='098287ee750f4884adc692cfc36a2802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Creating volume d3efdf64-ba8f-483c-9856-3d90d230318a {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:32 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:32 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a 1073741824 Apr 28 15:27:32 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb17890-c403-466e-b131-dcb94f412db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f7481b-2793-474e-95f9-a549ce6b825f', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466dd19-ad4c-4e1f-b4a9-1f340273f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:32 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-f5f7481b-2793-474e-95f9-a549ce6b825f (f5f7481b-2793-474e-95f9-a549ce6b825f): created successfully Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466dd19-ad4c-4e1f-b4a9-1f340273f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:32 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (6cd96e02-3072-4ff1-bd6e-a06e01986a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:32 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d1670092-f7de-44cb-885c-dcfdd9ab76dc tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:33 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a 1073741824" returned: 0 in 0.824s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:33 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a Apr 28 15:27:33 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:33 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a" returned: 0 in 0.584s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.060s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1321910642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b719900-10ef-4e90-8b75-13b2695ff8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:26Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Creating volume 3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:33 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:33 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 1073741824 Apr 28 15:27:33 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2154b1e4-2e3d-43b9-be0c-756ac937217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3efdf64-ba8f-483c-9856-3d90d230318a', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e707f9fd-793f-4f4e-8212-206b5a03ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:33 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Volume volume-d3efdf64-ba8f-483c-9856-3d90d230318a (d3efdf64-ba8f-483c-9856-3d90d230318a): created successfully Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e707f9fd-793f-4f4e-8212-206b5a03ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:33 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Flow 'volume_create_manager' (0c7c6ed1-5834-4976-9d9d-bdb6df019621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:33 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-277c76d9-92d4-4e7c-8e0e-2a3ef93a0f9d tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created volume successfully. Apr 28 15:27:34 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 1073741824" returned: 0 in 0.775s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-d3efdf64-ba8f-483c-9856-3d90d230318a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-d3efdf64-ba8f-483c-9856-3d90d230318a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:34 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:27:34 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-d3efdf64-ba8f-483c-9856-3d90d230318a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-d3efdf64-ba8f-483c-9856-3d90d230318a" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f467e633-ab7a-482d-984f-8fe5347ff8c8]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:34 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:34 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a Apr 28 15:27:34 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:35 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.635s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.662s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033-97c110af-c378-40e5-973e-64358ae54a79" by "_create_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b420ba-12c7-4503-bef3-6d77d701a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b719900-10ef-4e90-8b75-13b2695ff8c2', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba63a5-c2c9-4552-b3f6-5b10e3f0a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033-97c110af-c378-40e5-973e-64358ae54a79" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Creating volume 97c110af-c378-40e5-973e-64358ae54a79 from snapshot b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:35 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Volume volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 (3b719900-10ef-4e90-8b75-13b2695ff8c2): created successfully Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba63a5-c2c9-4552-b3f6-5b10e3f0a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (13f826f5-11c6-4b62-a503-922d251c2a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] snapshot: b118fb5d-8b66-450f-a235-e1e9a28ce033, volume: 97c110af-c378-40e5-973e-64358ae54a79, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=128,cinder:UPDATE=155,cinder:DELETE=21,cinder:INSERT=31 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:27:35 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-313ba117-2ad7-4fe4-8c5c-e66a8ea866fb tempest-VolumeDependencyTests-964110210 None] Created volume successfully. Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[627af04e-78a5-4da0-bcd3-e89770ff8f3b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:35 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a" returned: 0 in 0.755s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:35 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:35 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a Apr 28 15:27:35 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:35 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:35 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:36 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-d3efdf64-ba8f-483c-9856-3d90d230318a" returned: 0 in 0.624s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-d3efdf64-ba8f-483c-9856-3d90d230318a" released by "delete_volume" :: held 1.417s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=130,cinder:UPDATE=196,cinder:INSERT=48,cinder:DELETE=15 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:27:36 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 0.721s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f67f68c-939e-4600-8ae4-e89f622aec55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92009e4-a2fb-47bc-8700-436e448b9567]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['96322709-cf4e-4616-9876-18a46560a52c', '3a3dc4a8-0c1e-46b8-88ed-e9c3959d35ae', 'b344f8bd-50d8-40c4-8a05-2c1eb12ed9a5', '619053ef-dd47-42fd-b5ab-41b232a505e8'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:36 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:36 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:36 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:36 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:36 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-f5f7481b-2793-474e-95f9-a549ce6b825f-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-f5f7481b-2793-474e-95f9-a549ce6b825f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:37 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.675s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:37 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-f5f7481b-2793-474e-95f9-a549ce6b825f" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-f5f7481b-2793-474e-95f9-a549ce6b825f" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-e536d875-bb1d-491b-8eba-26cb245cb2ba tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-d3efdf64-ba8f-483c-9856-3d90d230318a-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6858eab-9fe1-405e-b8b5-98eee1ec098b]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (374b5bd8-5301-4748-9330-e71b9d51bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebe6b57-5403-4d58-ad24-3bdef4c73e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:37 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebe6b57-5403-4d58-ad24-3bdef4c73e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1593799059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aaba49-192c-482e-a80a-44288e7fe27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafc9de86fd48a489b77adc82f1b477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3b719900-10ef-4e90-8b75-13b2695ff8c2,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:37Z,use_quota=True,user_id='b6b883ea92ee437da2394f94a20e13e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287c6802-9db5-4ceb-b783-46751e9d0afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287c6802-9db5-4ceb-b783-46751e9d0afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b5dacb-beac-4a5a-a11a-18acded668c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.966s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:37 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f Apr 28 15:27:37 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b5dacb-beac-4a5a-a11a-18acded668c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '43aaba49-192c-482e-a80a-44288e7fe27a', 'volume_name': 'volume-43aaba49-192c-482e-a80a-44288e7fe27a', 'volume_size': 1, 'source_volid': '3b719900-10ef-4e90-8b75-13b2695ff8c2', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:37 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 Apr 28 15:27:37 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ee833c-3806-4c50-8177-6b7f2e2f231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ee833c-3806-4c50-8177-6b7f2e2f231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a649b4-7939-449a-97bf-45423f42081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:37 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Volume 43aaba49-192c-482e-a80a-44288e7fe27a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-43aaba49-192c-482e-a80a-44288e7fe27a', 'volume_size': 1, 'source_volid': '3b719900-10ef-4e90-8b75-13b2695ff8c2', 'source_volstatus': 'available'} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:37 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f" returned: 0 in 0.757s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:37 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:37 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f Apr 28 15:27:37 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:38 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:38 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-f5f7481b-2793-474e-95f9-a549ce6b825f" returned: 0 in 1.009s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:38 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-f5f7481b-2793-474e-95f9-a549ce6b825f" released by "delete_volume" :: held 1.832s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['f4543a55-3299-4eee-abde-8dd4d5e0c35f', '75e5370a-8b8d-479a-a270-725054bbef48', '816cb0db-440d-4550-95fa-d7a5c1065475', '57b59f07-f061-484c-b304-f679fab44924'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:39 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:39 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-230b4a2b-f351-4166-afd1-4788dff5432e-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-230b4a2b-f351-4166-afd1-4788dff5432e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-230b4a2b-f351-4166-afd1-4788dff5432e" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-230b4a2b-f351-4166-afd1-4788dff5432e" acquired by "delete_volume" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9670132-9953-4779-b04b-75da89171892]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:39 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:40 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e Apr 28 15:27:40 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:40 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:40 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.659s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:40 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:40 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:40 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05061158-0a36-461c-aef2-f5f5b9a2c2f6 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-f5f7481b-2793-474e-95f9-a549ce6b825f-delete_volume" released by "delete_volume" :: held 3.972s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:41 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e" returned: 0 in 1.859s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:41 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:41 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e Apr 28 15:27:41 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:42 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79" returned: 0 in 5.675s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:42 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e72002-b81f-4054-aa3a-4b0baeb7076c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:42 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:42 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-230b4a2b-f351-4166-afd1-4788dff5432e" returned: 0 in 1.408s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:42 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-230b4a2b-f351-4166-afd1-4788dff5432e" released by "delete_volume" :: held 3.344s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['75b6d8bb-fc21-4303-b073-19037573068f', '526b3ba4-6740-45dd-a161-76cbd82e58a1', 'c6255e14-1026-4062-9ff7-45f64c56bcee', 'b22b40fd-2cbf-4b4d-93bf-673b46c61c43'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:43 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:43 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:43 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:43 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:43 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.606s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:43 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-3630a3ef-34ed-4ee2-bd8b-cc2144b193c9 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-230b4a2b-f351-4166-afd1-4788dff5432e-delete_volume" released by "delete_volume" :: held 4.243s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:43 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.910s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:27:43 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Converted 1024.00 MB image at 180.39 MB/s Apr 28 15:27:43 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 is being set with open permissions: ugo+rw Apr 28 15:27:43 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:43 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 Apr 28 15:27:43 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-e36ea98a-826f-4653-9d10-fc96b7afbdc7-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-e36ea98a-826f-4653-9d10-fc96b7afbdc7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-e36ea98a-826f-4653-9d10-fc96b7afbdc7" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-e36ea98a-826f-4653-9d10-fc96b7afbdc7" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5747c-e2ba-4245-94fc-38741123c84c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:44 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 Apr 28 15:27:44 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:44 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79" returned: 0 in 0.599s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" released by "_copy_volume_from_snapshot" :: held 8.984s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033-97c110af-c378-40e5-973e-64358ae54a79" released by "_create_volume_from_snapshot" :: held 9.036s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.076s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.035s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1103c731-a975-46bb-9240-1b1981aa52dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e4211385114de89026c958be2ef2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:32Z,use_quota=True,user_id='4e612cdca31944d28560a2ac1857a740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Creating volume 1103c731-a975-46bb-9240-1b1981aa52dd {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:27:44 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:44 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd 1073741824 Apr 28 15:27:44 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e86e7c-edc9-4110-83aa-0f8aa9ab6cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c110af-c378-40e5-973e-64358ae54a79', 'volume_size': 1, 'snapshot_id': 'b118fb5d-8b66-450f-a235-e1e9a28ce033'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52dba65-10f1-414b-9a17-5d033fbe2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:44 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Volume volume-97c110af-c378-40e5-973e-64358ae54a79 (97c110af-c378-40e5-973e-64358ae54a79): created successfully Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52dba65-10f1-414b-9a17-5d033fbe2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Flow 'volume_create_manager' (8b64bb2d-98ce-4f28-b580-7652f9b3ae44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:44 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-652f199f-c6c3-42cc-82c9-cbc343854f64 tempest-SnapshotDependencyTests-1753890626 None] Created volume successfully. Apr 28 15:27:44 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7" returned: 0 in 0.720s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:44 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:44 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7 Apr 28 15:27:44 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-b118fb5d-8b66-450f-a235-e1e9a28ce033-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-b118fb5d-8b66-450f-a235-e1e9a28ce033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Deleting offline snapshot b118fb5d-8b66-450f-a235-e1e9a28ce033 of volume 7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] snapshot_file for this snap is: volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5fec14-5f9b-4442-a5fb-a8a1d8c5a454]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:45 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:45 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:45 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd 1073741824" returned: 0 in 0.906s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:45 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd Apr 28 15:27:45 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:45 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-e36ea98a-826f-4653-9d10-fc96b7afbdc7" returned: 0 in 0.641s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-e36ea98a-826f-4653-9d10-fc96b7afbdc7" released by "delete_volume" :: held 1.403s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['48c65754-3c75-400b-9515-24f555fe92e1', '5890607a-2b97-4987-8435-3df57889dd4d', '37c15f83-6a31-4683-be80-68b4e7d06e14', '04546dd1-3e88-45f3-aed5-e74bda57a687'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:45 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:45 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:45 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:46 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 0.783s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f67f68c-939e-4600-8ae4-e89f622aec55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f643a1c-5ad4-4eec-ba24-ea0b9299ab8c]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:46 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd" returned: 0 in 0.668s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.794s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:46 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Cloning volume 3b719900-10ef-4e90-8b75-13b2695ff8c2 to volume 43aaba49-192c-482e-a80a-44288e7fe27a Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87963eea-9f63-4511-9a1b-dcd4af058182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1103c731-a975-46bb-9240-1b1981aa52dd', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da1ed5-3711-4c46-9380-944e8a2f2edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Creating offline snapshot d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 of volume 3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:27:46 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Volume volume-1103c731-a975-46bb-9240-1b1981aa52dd (1103c731-a975-46bb-9240-1b1981aa52dd): created successfully Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da1ed5-3711-4c46-9380-944e8a2f2edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Flow 'volume_create_manager' (b6c6c3b2-7f7f-40f5-8831-67a213c83d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca257128-65ad-44d3-95fb-e55c520aecaa]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:46 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:46 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-20bc79e3-08e4-4aef-9aa7-32fd97ac9f2b tempest-CinderUnicodeTest-660437278 None] Created volume successfully. Apr 28 15:27:46 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-06f73179-7728-466b-a57a-d658777be996-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.660s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:46 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-06f73179-7728-466b-a57a-d658777be996-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-5a14aed4-f605-49ac-83d5-26297ade3bc0 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-e36ea98a-826f-4653-9d10-fc96b7afbdc7-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:46 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:27:46 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-06f73179-7728-466b-a57a-d658777be996" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-06f73179-7728-466b-a57a-d658777be996" acquired by "delete_volume" :: waited 0.017s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae0127-2b45-4096-8e23-820961490e63]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:46 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 Apr 28 15:27:46 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:46 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.811s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:46 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:46 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:46 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:47 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.857s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:47 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 1G Apr 28 15:27:47 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84270) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Flow 'volume_create_manager' (2d101083-ce27-421a-aee8-c9085c748ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd77c97a-63da-4770-b289-1232eada85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd77c97a-63da-4770-b289-1232eada85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1933421243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56affba5-f4fa-4894-960e-c61aa69c4385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e4211385114de89026c958be2ef2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:47Z,use_quota=True,user_id='4e612cdca31944d28560a2ac1857a740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633587f4-2656-4c81-8d66-33bc3d916700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633587f4-2656-4c81-8d66-33bc3d916700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ace13ad-ba9c-4e32-a2cb-aa4eba66a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ace13ad-ba9c-4e32-a2cb-aa4eba66a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56affba5-f4fa-4894-960e-c61aa69c4385', 'volume_name': 'volume-56affba5-f4fa-4894-960e-c61aa69c4385', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7176301-b377-4102-a6bd-bb6f24202b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7176301-b377-4102-a6bd-bb6f24202b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8178235f-e943-4998-8b6b-839758bc353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:27:47 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Volume 56affba5-f4fa-4894-960e-c61aa69c4385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56affba5-f4fa-4894-960e-c61aa69c4385', 'volume_size': 1} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:47 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996" returned: 0 in 0.898s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:47 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996 Apr 28 15:27:47 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:47 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 0.844s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:47 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033 Apr 28 15:27:47 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:47 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 1G" returned: 0 in 0.859s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:47 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:27:47 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:47 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-06f73179-7728-466b-a57a-d658777be996" returned: 0 in 0.652s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:47 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-06f73179-7728-466b-a57a-d658777be996" released by "delete_volume" :: held 1.588s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['6b0f12c7-46ce-4c96-903d-ae8ca9f9abb0', 'e0bfa465-ee58-4cc1-86f8-783093e78c0e', '6aa8f6e7-dc88-47b4-a695-edf0809ff712', 'bc35da30-ae23-487e-bca6-336bc2bf6330'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:48 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:48 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:48 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55.b118fb5d-8b66-450f-a235-e1e9a28ce033" returned: 0 in 0.674s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-b118fb5d-8b66-450f-a235-e1e9a28ce033" released by "_delete_snapshot" :: held 3.232s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" released by "delete_snapshot" :: held 3.259s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Created reservations ['681d3c46-52d6-49bf-bcac-facf52846412', '8e4c98ea-a797-4ae0-9e0a-891519ba6c97', '265cfd63-439c-44a7-a586-67de1de58bbb', 'b20251b1-8129-4d34-824d-837b0e2e543b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:48 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.664s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:48 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 is being set with open permissions: ugo+rw Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-4d6b8078-d313-4bc8-9191-8e93dd9c547d-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:48 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:27:48 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-4d6b8078-d313-4bc8-9191-8e93dd9c547d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Delete snapshot completed successfully. Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-db973d05-4ad9-4bce-b5ff-462f22ff8eeb tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-b118fb5d-8b66-450f-a235-e1e9a28ce033-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "cinder-quobyte-4d6b8078-d313-4bc8-9191-8e93dd9c547d" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-4d6b8078-d313-4bc8-9191-8e93dd9c547d" acquired by "delete_volume" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd89451-e9e7-49b7-a80c-39ca0e3a7ccb]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:48 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.662s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:48 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:48 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-05df6d4e-0c17-443a-80e2-02d40dff2aa3 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-06f73179-7728-466b-a57a-d658777be996-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:48 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d Apr 28 15:27:48 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:49 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.649s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:49 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info Apr 28 15:27:49 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:49 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d" returned: 0 in 0.708s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-7f67f68c-939e-4600-8ae4-e89f622aec55-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:49 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d Apr 28 15:27:49 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-7f67f68c-939e-4600-8ae4-e89f622aec55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd639e7-8cf4-4b7c-b5d9-3229e62cfa89]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:49 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:49 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:49 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info" returned: 0 in 0.717s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:49 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info is being set with open permissions: ugo+rw Apr 28 15:27:49 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:49 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info Apr 28 15:27:49 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:50 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-4d6b8078-d313-4bc8-9191-8e93dd9c547d" returned: 0 in 0.646s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-quobyte-4d6b8078-d313-4bc8-9191-8e93dd9c547d" released by "delete_volume" :: held 1.406s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Created reservations ['e6d93ed1-5a62-44a1-9f78-dc245d550596', '2dbb5308-1f83-4910-8035-1debdd951f05', 'c6730482-5a95-4a45-b29a-372195b42975', '180dbb39-578a-40da-923e-8bda4a5a5ad9'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:50 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:50 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:50 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.773s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:50 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55 Apr 28 15:27:50 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_service.periodic_task [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84270) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-417e6a60-08e0-448c-9246-562000458317 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:50 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:50 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:50 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.info" returned: 0 in 0.896s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" by "_copy_volume_from_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] snapshot: d61ddb5b-3fa3-401b-b57a-9f50ec5c3782, volume: 43aaba49-192c-482e-a80a-44288e7fe27a, {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4c6f2-a091-49f8-b031-214b01cd5cb6]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:50 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:51 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.856s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:51 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Deleted volume successfully. Apr 28 15:27:51 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:27:51 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-f835da25-804b-496c-a28a-47ae38db7ab4 tempest-CreateVolumesFromSourceVolumeTest-442382500 None] Lock "cinder-4d6b8078-d313-4bc8-9191-8e93dd9c547d-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:51 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-7f67f68c-939e-4600-8ae4-e89f622aec55" returned: 0 in 0.852s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-7f67f68c-939e-4600-8ae4-e89f622aec55" released by "delete_volume" :: held 1.688s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Created reservations ['cf917b53-dd12-45f0-bb9e-2ca92fa3c85d', '2eb5da96-de3f-4467-90e3-4a78dd150dc9', '86a1cd02-854e-4a49-8def-9b9850246f13', '887697da-6964-4dde-977f-9aeaed86bc19'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:51 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-417e6a60-08e0-448c-9246-562000458317 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.880s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-417e6a60-08e0-448c-9246-562000458317 None None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:51 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:51 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-97c110af-c378-40e5-973e-64358ae54a79-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-97c110af-c378-40e5-973e-64358ae54a79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:51 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.915s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b719900-10ef-4e90-8b75-13b2695ff8c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Creating direct copy from snapshot {{(pid=84270) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" acquired by "delete_volume" :: waited 0.034s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd3681c-e862-42fb-90d2-7e8914890524]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ddd744-fe99-42be-8298-a56d985c3644]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:51 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:52 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:27:52 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:52 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 Apr 28 15:27:52 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:52 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.795s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:52 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Deleted volume successfully. Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fe61a3a1-b557-42ac-8461-a72094917d79 tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-7f67f68c-939e-4600-8ae4-e89f622aec55-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:52 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.867s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG cinder.utils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Path /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a not found in is_blk_device check {{(pid=84270) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:52 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a Apr 28 15:27:52 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:52 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79" returned: 0 in 0.943s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:52 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:52 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79 Apr 28 15:27:52 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:53 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-97c110af-c378-40e5-973e-64358ae54a79" returned: 0 in 0.670s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-quobyte-97c110af-c378-40e5-973e-64358ae54a79" released by "delete_volume" :: held 1.712s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Created reservations ['4911a592-2dd1-4f01-9005-40cdf4e0ee54', '8c7926b2-23f0-48f8-a526-34fd33cd7b22', '1da4ce57-63bf-4f99-be0c-a1adf658a0ae', '1d2695f8-2afb-4bcb-9b93-c00d71ebcd57'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:27:53 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:53 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:27:53 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:54 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:54 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 1.109s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:54 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:27:54 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Deleted volume successfully. Apr 28 15:27:55 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-62c9e9c8-b4d0-4e29-ad84-6f3a16d2c96c tempest-SnapshotDependencyTests-1753890626 None] Lock "cinder-97c110af-c378-40e5-973e-64358ae54a79-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:58 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a" returned: 0 in 5.451s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:58 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[307123c3-d6f0-42a8-82ce-b86468683b6e]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:58 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:58 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:27:58 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:59 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.983s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.image.image_utils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a {{(pid=84270) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 15:27:59 devstack cinder-volume[84270]: INFO cinder.image.image_utils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Converted 1024.00 MB image at 187.82 MB/s Apr 28 15:27:59 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a is being set with open permissions: ugo+rw Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:27:59 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a Apr 28 15:27:59 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:27:59 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a" returned: 0 in 0.641s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" released by "_copy_volume_from_snapshot" :: held 8.994s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Deleting offline snapshot d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 of volume 3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] snapshot_file for this snap is: volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd08883-6910-4f6f-9523-956f49801778]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:27:59 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:00 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:28:00 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:00 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.776s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:00 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b719900-10ef-4e90-8b75-13b2695ff8c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:28:00 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee03882-6baa-4526-ba54-e076896923f3]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:00 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:00 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:28:00 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:01 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.792s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:01 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:01 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:28:01 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:02 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.712s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:02 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782 Apr 28 15:28:02 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:02 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:02 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2.d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" returned: 0 in 0.675s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-d61ddb5b-3fa3-401b-b57a-9f50ec5c3782" released by "_delete_snapshot" :: held 3.070s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.999s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.848s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T13:27:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1933421243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56affba5-f4fa-4894-960e-c61aa69c4385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e4211385114de89026c958be2ef2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T13:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T13:27:47Z,use_quota=True,user_id='4e612cdca31944d28560a2ac1857a740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99be8ad9-09f2-409a-899b-ae0b34326023),volume_type_id=99be8ad9-09f2-409a-899b-ae0b34326023)}" {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Creating volume 56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Selected osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 as target Quobyte volume. {{(pid=84270) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 15:28:03 devstack cinder-volume[84270]: INFO cinder.volume.drivers.remotefs [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] casted to osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353 Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 1073741824 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a649b4-7939-449a-97bf-45423f42081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aaba49-192c-482e-a80a-44288e7fe27a', 'volume_size': 1, 'source_volid': '3b719900-10ef-4e90-8b75-13b2695ff8c2', 'source_volstatus': 'available'}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:28:03 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 1073741824 Apr 28 15:28:03 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58da9684-6939-47c9-8291-b158b46865a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:28:03 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Volume volume-43aaba49-192c-482e-a80a-44288e7fe27a (43aaba49-192c-482e-a80a-44288e7fe27a): created successfully Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58da9684-6939-47c9-8291-b158b46865a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Flow 'volume_create_manager' (374b5bd8-5301-4748-9330-e71b9d51bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:28:03 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-811a037c-1829-4ea3-9df8-9116ab098313 tempest-VolumeDependencyTests-964110210 None] Created volume successfully. Apr 28 15:28:03 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:03 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 1073741824" returned: 0 in 0.865s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:04 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 Apr 28 15:28:04 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-3b719900-10ef-4e90-8b75-13b2695ff8c2-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-3b719900-10ef-4e90-8b75-13b2695ff8c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-3b719900-10ef-4e90-8b75-13b2695ff8c2" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-3b719900-10ef-4e90-8b75-13b2695ff8c2" acquired by "delete_volume" :: waited 0.018s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0335677-252c-4657-9361-a07eb9986b6d]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:04 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:28:04 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:04 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385" returned: 0 in 0.731s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'} {{(pid=84270) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8178235f-e943-4998-8b6b-839758bc353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56affba5-f4fa-4894-960e-c61aa69c4385', 'volume_size': 1}' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1b4370-2795-48e2-aff5-f5b8bac4dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 15:28:04 devstack cinder-volume[84270]: INFO cinder.volume.flows.manager.create_volume [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Volume volume-56affba5-f4fa-4894-960e-c61aa69c4385 (56affba5-f4fa-4894-960e-c61aa69c4385): created successfully Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1b4370-2795-48e2-aff5-f5b8bac4dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84270) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 15:28:04 devstack cinder-volume[84270]: DEBUG cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Flow 'volume_create_manager' (2d101083-ce27-421a-aee8-c9085c748ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84270) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 15:28:04 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-45a9f2a8-5415-41c1-a344-3b6125c1c550 tempest-CinderUnicodeTest-660437278 None] Created volume successfully. Apr 28 15:28:05 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.788s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:05 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2 Apr 28 15:28:05 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:05 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-3b719900-10ef-4e90-8b75-13b2695ff8c2" returned: 0 in 0.669s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-3b719900-10ef-4e90-8b75-13b2695ff8c2" released by "delete_volume" :: held 1.531s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Created reservations ['7c594c78-e2a1-4cc5-8526-4789366d505e', '59ba7915-2949-4b99-a396-9a0041150a84', 'e1ee627b-39b5-4556-b1de-cb7cae714936', '4e83bc7d-2a47-48b3-8713-c085e0cf422f'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:05 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:06 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:28:06 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Creating offline snapshot d4ff97e0-16b6-4ea1-bac8-5ff889be6896 of volume 56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6fca60-15ac-44b1-bc26-de9bb857b1f0]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:06 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 Apr 28 15:28:06 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-43aaba49-192c-482e-a80a-44288e7fe27a-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-43aaba49-192c-482e-a80a-44288e7fe27a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" acquired by "delete_volume" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[a425d5ab-aaf7-444b-a6a5-94f0895fe111]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:06 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.680s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:28:06 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Deleted volume successfully. Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-b64a7793-3e24-4917-86f5-e5a1476b44c2 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-3b719900-10ef-4e90-8b75-13b2695ff8c2-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:06 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a Apr 28 15:28:06 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:06 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385" returned: 0 in 0.780s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:06 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 1G {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:06 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 1G Apr 28 15:28:06 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:07 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a" returned: 0 in 0.734s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:07 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a Apr 28 15:28:07 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:07 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 1G" returned: 0 in 0.785s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56affba5-f4fa-4894-960e-c61aa69c4385 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:07 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56affba5-f4fa-4894-960e-c61aa69c4385 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 Apr 28 15:28:07 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:07 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:07 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-43aaba49-192c-482e-a80a-44288e7fe27a" returned: 0 in 0.605s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-43aaba49-192c-482e-a80a-44288e7fe27a" released by "delete_volume" :: held 1.397s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Created reservations ['5f7fd6de-e57c-4723-9caa-3fd264c8904c', '3d87ab50-8d27-4bfc-a821-869af38b184c', 'd9074ea6-1bf8-47aa-8f9f-70be67eb0f0b', '9736c861-2839-4bc8-b7fc-3e8e970072b2'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:08 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:28:08 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:08 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56affba5-f4fa-4894-960e-c61aa69c4385 -F qcow2 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896" returned: 0 in 0.659s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:08 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 is being set with open permissions: ugo+rw Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:08 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 Apr 28 15:28:08 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:08 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.604s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:28:08 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Deleted volume successfully. Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-355d53a8-ccc7-4d36-8964-310302cb41f8 tempest-VolumeDependencyTests-964110210 None] Lock "cinder-43aaba49-192c-482e-a80a-44288e7fe27a-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "cinder-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Acquiring lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" acquired by "delete_volume" :: waited 0.022s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd7354b-0ebb-4bd6-9a36-a50ff82e0e42]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:08 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896" returned: 0 in 0.610s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:08 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:08 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info Apr 28 15:28:08 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:09 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 Apr 28 15:28:09 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:09 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info" returned: 0 in 0.583s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:09 devstack cinder-volume[84270]: WARNING cinder.volume.drivers.remotefs [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info is being set with open permissions: ugo+rw Apr 28 15:28:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:09 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info Apr 28 15:28:09 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:09 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" returned: 0 in 0.753s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:09 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:09 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55 Apr 28 15:28:09 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:10 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.info" returned: 0 in 0.579s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:10 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-184a0304-e8c4-445c-a2d8-450a4b95d113 tempest-CinderUnicodeTest-660437278 None] Create snapshot completed successfully Apr 28 15:28:10 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" returned: 0 in 0.645s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "cinder-quobyte-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55" released by "delete_volume" :: held 1.440s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Created reservations ['f4a1756a-d261-4b1a-b877-effbdc505422', 'd476b429-6e83-43e2-af0f-6d4b68ca5395', 'd04f84b3-b126-4596-8ed9-9dde7b315e6d', 'ca520687-a670-404c-a8c7-8aa9e6cc4f3b'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:10 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:10 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:28:10 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:11 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.607s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:28:11 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Deleted volume successfully. Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-13b0dc0b-d8e0-4b5d-8d43-b456021aafaf tempest-VolumeDependencyTests-964110210 None] Lock "cinder-39710e2c-d9ee-4d7b-a73d-71ae3f7e1c55-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-d4ff97e0-16b6-4ea1-bac8-5ff889be6896-delete_snapshot" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-d4ff97e0-16b6-4ea1-bac8-5ff889be6896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" by "delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-quobyte-d4ff97e0-16b6-4ea1-bac8-5ff889be6896" by "_delete_snapshot" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-d4ff97e0-16b6-4ea1-bac8-5ff889be6896" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Deleting offline snapshot d4ff97e0-16b6-4ea1-bac8-5ff889be6896 of volume 56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] snapshot_file for this snap is: volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f57f2-9ad1-48d8-aba3-be635390bbfc]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:11 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:11 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 Apr 28 15:28:11 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:12 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896" returned: 0 in 0.716s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.remotefs [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56affba5-f4fa-4894-960e-c61aa69c4385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84270) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24cabb-0e7d-45bc-b651-38f328396275]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:12 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 Apr 28 15:28:12 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:12 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385" returned: 0 in 0.741s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:12 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:12 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 Apr 28 15:28:12 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:13 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896" returned: 0 in 0.722s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:13 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:13 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896 Apr 28 15:28:13 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:14 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385.d4ff97e0-16b6-4ea1-bac8-5ff889be6896" returned: 0 in 0.593s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-d4ff97e0-16b6-4ea1-bac8-5ff889be6896" released by "_delete_snapshot" :: held 2.887s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" released by "delete_snapshot" :: held 2.915s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Created reservations ['de985fac-b141-435b-916a-bc908cf617e5', 'cc5af7db-9e0a-4144-b27f-0ea7f17bb744', 'e0569036-be70-4c5c-bc28-6ce22ad15f2c', 'ae26405c-e5e0-4b46-994a-8149f5e0794d'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:14 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Delete snapshot completed successfully. Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fc83b24d-3c5f-479a-b30c-e9bbbed3ba9f tempest-CinderUnicodeTest-660437278 None] Lock "cinder-d4ff97e0-16b6-4ea1-bac8-5ff889be6896-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-56affba5-f4fa-4894-960e-c61aa69c4385-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-56affba5-f4fa-4894-960e-c61aa69c4385-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0ea04-74f3-4b99-a43e-3bfeb91eb807]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:14 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:14 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 Apr 28 15:28:14 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:15 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385" returned: 0 in 0.720s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:15 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385 Apr 28 15:28:15 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:15 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:15 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-56affba5-f4fa-4894-960e-c61aa69c4385" returned: 0 in 0.601s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:15 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-56affba5-f4fa-4894-960e-c61aa69c4385" released by "delete_volume" :: held 1.378s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Created reservations ['8211f1a4-24f9-488f-969b-f967394db288', '1971d3d8-8f83-41a5-a425-4438fd3cb6fb', '881711eb-115c-4d58-b330-b5aa89ba4baa', 'c2ca0135-1a43-4947-94a5-a814682f0601'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:16 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:28:16 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:16 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.595s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:28:16 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Deleted volume successfully. Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-d6e5e13e-cc0e-4863-8925-20a7e019f1c4 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-56affba5-f4fa-4894-960e-c61aa69c4385-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-1103c731-a975-46bb-9240-1b1981aa52dd-delete_volume" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-1103c731-a975-46bb-9240-1b1981aa52dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "cinder-quobyte-1103c731-a975-46bb-9240-1b1981aa52dd" by "delete_volume" {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-1103c731-a975-46bb-9240-1b1981aa52dd" acquired by "delete_volume" :: waited 0.015s {{(pid=84270) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo.privsep.daemon [-] privsep: reply[14746de3-fde2-4948-a084-4b1a5e9ae0ce]: (4, 'qcow2') {{(pid=84876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 15:28:16 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:16 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd Apr 28 15:28:16 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:17 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd" returned: 0 in 0.711s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:17 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:17 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd Apr 28 15:28:17 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:18 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63/volume-1103c731-a975-46bb-9240-1b1981aa52dd" returned: 0 in 0.616s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-quobyte-1103c731-a975-46bb-9240-1b1981aa52dd" released by "delete_volume" :: held 1.368s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.quota [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Created reservations ['bbf81002-85de-4c66-ae7f-f17e119647c1', 'b25512e8-f6c0-44ac-8132-06aafd5855f4', '3943259f-e022-4ef9-a5ae-6c1156bfbd41', 'e348726b-d29c-44db-985f-4a3f9f7a4ef6'] {{(pid=84270) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353': None} {{(pid=84270) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.volume.drivers.quobyte [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cbe9e19-fd2d-4d19-ae4c-c29a88e47353'] {{(pid=84270) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.lockutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84270) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 15:28:18 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63 Apr 28 15:28:18 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 15:28:18 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG oslo_concurrency.processutils [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f06dd97cb432942b0e7fb71ed838e63" returned: 0 in 0.623s {{(pid=84270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.manager [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Notifying Schedulers of capabilities ... {{(pid=84270) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 15:28:18 devstack cinder-volume[84270]: INFO cinder.volume.manager [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Deleted volume successfully. Apr 28 15:28:18 devstack cinder-volume[84270]: DEBUG cinder.coordination [None req-fcc66f2b-e7cb-43e4-993e-fc3ea6942757 tempest-CinderUnicodeTest-660437278 None] Lock "cinder-1103c731-a975-46bb-9240-1b1981aa52dd-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=84270) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 15:28:28 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:SELECT=90,cinder:INSERT=37,cinder:UPDATE=129,cinder:DELETE=9 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 15:28:28 devstack cinder-volume[84270]: DEBUG dbcounter [-] [84270] Writing DB stats cinder:INSERT=29,cinder:UPDATE=126,cinder:SELECT=83,cinder:DELETE=9 {{(pid=84270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}